INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53822 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:30:32,445 - lava_callback - INFO - Received callback for node 69aebcf6feb96b28aa34ab56 2026-03-09 12:30:32,452 - lava_callback - INFO - Starting async job submit for node 69aebcf6feb96b28aa34ab56 INFO: 172.20.0.1:54718 - "POST /node/69aebcf6feb96b28aa34ab56 HTTP/1.0" 202 Accepted 2026-03-09 12:30:32,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:30:32,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aebcf6feb96b28aa34ab56 HTTP/1.1" 200 None 2026-03-09 12:30:32,497 - lava_callback - DEBUG - Processing node 69aebcf6feb96b28aa34ab56: baseline-arm 2026-03-09 12:30:32,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:30:32,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:30:32,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aebcf6feb96b28aa34ab56/log.txt.gz 2026-03-09 12:30:32,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:30:33,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:30:33,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aebcf6feb96b28aa34ab56/lava-logs.yaml 2026-03-09 12:30:33,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:30:33,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:30:33,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aebcf6feb96b28aa34ab56/lava_callback.json.gz 2026-03-09 12:30:33,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:30:33,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aebcf6feb96b28aa34ab56 HTTP/1.1" 200 None 2026-03-09 12:30:33,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:30:33,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba38feb96b28aa34a77b HTTP/1.1" 200 None 2026-03-09 12:30:33,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:30:33,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aebcf6feb96b28aa34ab56 HTTP/1.1" 200 None 2026-03-09 12:30:33,546 - lava_callback - INFO - Completed processing callback for node 69aebcf6feb96b28aa34ab56 INFO: 172.20.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:31:03,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:31:03,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49456 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:43:36,510 - lava_callback - INFO - Received callback for node 69aec060feb96b28aa34ab89 INFO: 172.20.0.1:49458 - "POST /node/69aec060feb96b28aa34ab89 HTTP/1.0" 202 Accepted 2026-03-09 12:43:36,517 - lava_callback - INFO - Starting async job submit for node 69aec060feb96b28aa34ab89 2026-03-09 12:43:36,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:43:36,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec060feb96b28aa34ab89 HTTP/1.1" 200 None 2026-03-09 12:43:36,550 - lava_callback - DEBUG - Processing node 69aec060feb96b28aa34ab89: baseline-x86 2026-03-09 12:43:36,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:43:36,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:43:36,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aec060feb96b28aa34ab89/log.txt.gz 2026-03-09 12:43:37,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:43:37,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:43:37,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aec060feb96b28aa34ab89/lava-logs.yaml 2026-03-09 12:43:37,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:43:37,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:43:37,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aec060feb96b28aa34ab89/lava_callback.json.gz 2026-03-09 12:43:37,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:43:37,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec060feb96b28aa34ab89 HTTP/1.1" 200 None 2026-03-09 12:43:37,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:43:37,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba54feb96b28aa34a79d HTTP/1.1" 200 None 2026-03-09 12:43:37,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:43:37,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec060feb96b28aa34ab89 HTTP/1.1" 200 None 2026-03-09 12:43:37,467 - lava_callback - INFO - Completed processing callback for node 69aec060feb96b28aa34ab89 INFO: 172.20.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56324 - "GET /node/6991f8b501ff1e8e0859db2c%5Cn HTTP/1.0" 405 Method Not Allowed 2026-03-09 12:44:02,429 - lava_callback - INFO - Received callback for node 69aec062feb96b28aa34ab92 INFO: 172.20.0.1:56326 - "POST /node/69aec062feb96b28aa34ab92 HTTP/1.0" 202 Accepted 2026-03-09 12:44:02,435 - lava_callback - INFO - Starting async job submit for node 69aec062feb96b28aa34ab92 2026-03-09 12:44:02,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:02,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec062feb96b28aa34ab92 HTTP/1.1" 200 None 2026-03-09 12:44:02,468 - lava_callback - DEBUG - Processing node 69aec062feb96b28aa34ab92: baseline-x86 2026-03-09 12:44:02,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:44:02,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:44:02,790 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aec062feb96b28aa34ab92/log.txt.gz 2026-03-09 12:44:02,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:44:03,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:44:03,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aec062feb96b28aa34ab92/lava-logs.yaml 2026-03-09 12:44:03,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:44:03,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:44:03,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aec062feb96b28aa34ab92/lava_callback.json.gz 2026-03-09 12:44:03,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:03,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec062feb96b28aa34ab92 HTTP/1.1" 200 None 2026-03-09 12:44:03,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:03,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba54feb96b28aa34a79d HTTP/1.1" 200 None 2026-03-09 12:44:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:03,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec062feb96b28aa34ab92 HTTP/1.1" 200 None 2026-03-09 12:44:03,410 - lava_callback - INFO - Completed processing callback for node 69aec062feb96b28aa34ab92 2026-03-09 12:44:03,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:03,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55656 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:44:50,797 - lava_callback - INFO - Received callback for node 69aec061feb96b28aa34ab8f INFO: 172.20.0.1:47140 - "POST /node/69aec061feb96b28aa34ab8f HTTP/1.0" 202 Accepted 2026-03-09 12:44:50,812 - lava_callback - INFO - Starting async job submit for node 69aec061feb96b28aa34ab8f 2026-03-09 12:44:50,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:50,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec061feb96b28aa34ab8f HTTP/1.1" 200 None 2026-03-09 12:44:50,884 - lava_callback - DEBUG - Processing node 69aec061feb96b28aa34ab8f: baseline-x86 2026-03-09 12:44:51,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:44:51,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:44:51,516 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aec061feb96b28aa34ab8f/log.txt.gz 2026-03-09 12:44:51,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:44:52,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:44:52,140 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aec061feb96b28aa34ab8f/lava-logs.yaml 2026-03-09 12:44:52,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:44:52,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:44:52,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aec061feb96b28aa34ab8f/lava_callback.json.gz 2026-03-09 12:44:52,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:52,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec061feb96b28aa34ab8f HTTP/1.1" 200 None 2026-03-09 12:44:52,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:52,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba54feb96b28aa34a79d HTTP/1.1" 200 None INFO: 172.20.0.1:47152 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:44:52,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:44:52,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec061feb96b28aa34ab8f HTTP/1.1" 200 None 2026-03-09 12:44:52,422 - lava_callback - INFO - Completed processing callback for node 69aec061feb96b28aa34ab8f INFO: 172.20.0.1:47164 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:45:03,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:45:03,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-09 12:45:05,069 - lava_callback - INFO - Received callback for node 69aec060feb96b28aa34ab8c INFO: 172.20.0.1:45428 - "POST /node/69aec060feb96b28aa34ab8c HTTP/1.0" 202 Accepted 2026-03-09 12:45:05,079 - lava_callback - INFO - Starting async job submit for node 69aec060feb96b28aa34ab8c 2026-03-09 12:45:05,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:45:05,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec060feb96b28aa34ab8c HTTP/1.1" 200 None 2026-03-09 12:45:05,146 - lava_callback - DEBUG - Processing node 69aec060feb96b28aa34ab8c: baseline-x86 2026-03-09 12:45:05,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:45:05,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:45:05,764 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69aec060feb96b28aa34ab8c/log.txt.gz 2026-03-09 12:45:06,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:45:06,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:45:06,384 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69aec060feb96b28aa34ab8c/lava-logs.yaml 2026-03-09 12:45:06,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45438 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:45:06,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:45:06,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69aec060feb96b28aa34ab8c/lava_callback.json.gz 2026-03-09 12:45:06,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:45:06,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec060feb96b28aa34ab8c HTTP/1.1" 200 None 2026-03-09 12:45:06,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:45:06,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba54feb96b28aa34a79d HTTP/1.1" 200 None 2026-03-09 12:45:06,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:45:06,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec060feb96b28aa34ab8c HTTP/1.1" 200 None 2026-03-09 12:45:06,770 - lava_callback - INFO - Completed processing callback for node 69aec060feb96b28aa34ab8c INFO: 172.20.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42272 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:45:33,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:45:33,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51834 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:51838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:47:40,930 - lava_callback - INFO - Received callback for node 69aec15ffeb96b28aa34ac60 INFO: 172.20.0.1:44976 - "POST /node/69aec15ffeb96b28aa34ac60 HTTP/1.0" 202 Accepted 2026-03-09 12:47:40,945 - lava_callback - INFO - Starting async job submit for node 69aec15ffeb96b28aa34ac60 2026-03-09 12:47:40,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:47:40,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15ffeb96b28aa34ac60 HTTP/1.1" 200 None 2026-03-09 12:47:40,966 - lava_callback - DEBUG - Processing node 69aec15ffeb96b28aa34ac60: baseline-arm 2026-03-09 12:47:40,971 - lava_callback - WARNING - Failed to upload log 2026-03-09 12:47:40,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:47:41,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:47:41,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15ffeb96b28aa34ac60/lava-logs.yaml 2026-03-09 12:47:41,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:47:41,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:47:41,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15ffeb96b28aa34ac60/lava_callback.json.gz 2026-03-09 12:47:41,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:47:41,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15ffeb96b28aa34ac60 HTTP/1.1" 200 None 2026-03-09 12:47:41,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:47:41,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:47:41,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:47:41,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec15ffeb96b28aa34ac60 HTTP/1.1" 200 None 2026-03-09 12:47:41,322 - lava_callback - INFO - Completed processing callback for node 69aec15ffeb96b28aa34ac60 INFO: 172.20.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34400 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:48:03,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:03,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54838 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:48:13,706 - lava_callback - INFO - Received callback for node 69aebcf8feb96b28aa34ab59 INFO: 172.20.0.1:44768 - "POST /node/69aebcf8feb96b28aa34ab59 HTTP/1.0" 202 Accepted 2026-03-09 12:48:13,713 - lava_callback - INFO - Starting async job submit for node 69aebcf8feb96b28aa34ab59 2026-03-09 12:48:13,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:13,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aebcf8feb96b28aa34ab59 HTTP/1.1" 200 None 2026-03-09 12:48:13,797 - lava_callback - DEBUG - Processing node 69aebcf8feb96b28aa34ab59: ltp-smoke 2026-03-09 12:48:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:14,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:14,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69aebcf8feb96b28aa34ab59/log.txt.gz 2026-03-09 12:48:14,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:15,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:15,024 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69aebcf8feb96b28aa34ab59/lava-logs.yaml 2026-03-09 12:48:15,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44774 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 12:48:15,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:15,201 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69aebcf8feb96b28aa34ab59/lava_callback.json.gz 2026-03-09 12:48:15,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:15,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aebcf8feb96b28aa34ab59 HTTP/1.1" 200 None 2026-03-09 12:48:15,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:15,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba38feb96b28aa34a77b HTTP/1.1" 200 None 2026-03-09 12:48:15,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:15,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aebcf8feb96b28aa34ab59 HTTP/1.1" 200 None 2026-03-09 12:48:15,539 - lava_callback - INFO - Completed processing callback for node 69aebcf8feb96b28aa34ab59 INFO: 172.20.0.1:44784 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:48:17,735 - lava_callback - INFO - Received callback for node 69aec15ffeb96b28aa34ac63 INFO: 172.20.0.1:44800 - "POST /node/69aec15ffeb96b28aa34ac63 HTTP/1.0" 202 Accepted 2026-03-09 12:48:17,782 - lava_callback - INFO - Starting async job submit for node 69aec15ffeb96b28aa34ac63 2026-03-09 12:48:17,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:17,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15ffeb96b28aa34ac63 HTTP/1.1" 200 None 2026-03-09 12:48:17,817 - lava_callback - DEBUG - Processing node 69aec15ffeb96b28aa34ac63: baseline-arm 2026-03-09 12:48:17,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:18,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:18,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15ffeb96b28aa34ac63/log.txt.gz 2026-03-09 12:48:18,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:18,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:18,364 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15ffeb96b28aa34ac63/lava-logs.yaml 2026-03-09 12:48:18,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:18,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:18,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15ffeb96b28aa34ac63/lava_callback.json.gz 2026-03-09 12:48:18,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:18,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15ffeb96b28aa34ac63 HTTP/1.1" 200 None 2026-03-09 12:48:18,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:18,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:48:18,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:18,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec15ffeb96b28aa34ac63 HTTP/1.1" 200 None 2026-03-09 12:48:18,560 - lava_callback - INFO - Completed processing callback for node 69aec15ffeb96b28aa34ac63 2026-03-09 12:48:23,762 - lava_callback - INFO - Received callback for node 69aec162feb96b28aa34ac6e INFO: 172.20.0.1:42324 - "POST /node/69aec162feb96b28aa34ac6e HTTP/1.0" 202 Accepted 2026-03-09 12:48:23,809 - lava_callback - INFO - Starting async job submit for node 69aec162feb96b28aa34ac6e 2026-03-09 12:48:23,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:23,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec162feb96b28aa34ac6e HTTP/1.1" 200 None 2026-03-09 12:48:23,843 - lava_callback - DEBUG - Processing node 69aec162feb96b28aa34ac6e: baseline-arm 2026-03-09 12:48:23,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:24,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:24,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aec162feb96b28aa34ac6e/log.txt.gz 2026-03-09 12:48:24,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:24,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:24,370 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec162feb96b28aa34ac6e/lava-logs.yaml 2026-03-09 12:48:24,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:24,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:24,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec162feb96b28aa34ac6e/lava_callback.json.gz 2026-03-09 12:48:24,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:24,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec162feb96b28aa34ac6e HTTP/1.1" 200 None 2026-03-09 12:48:24,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:24,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:48:24,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:24,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec162feb96b28aa34ac6e HTTP/1.1" 200 None 2026-03-09 12:48:24,640 - lava_callback - INFO - Completed processing callback for node 69aec162feb96b28aa34ac6e INFO: 172.20.0.1:42336 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:48:33,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:33,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40926 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:48:52,831 - lava_callback - INFO - Received callback for node 69aec180feb96b28aa34ad22 INFO: 172.20.0.1:40932 - "POST /node/69aec180feb96b28aa34ad22 HTTP/1.0" 202 Accepted 2026-03-09 12:48:52,839 - lava_callback - INFO - Starting async job submit for node 69aec180feb96b28aa34ad22 2026-03-09 12:48:52,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:52,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec180feb96b28aa34ad22 HTTP/1.1" 200 None 2026-03-09 12:48:52,886 - lava_callback - DEBUG - Processing node 69aec180feb96b28aa34ad22: baseline-arm-pengutronix 2026-03-09 12:48:53,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:53,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:53,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec180feb96b28aa34ad22/log.txt.gz 2026-03-09 12:48:53,268 - lava_callback - INFO - Received callback for node 69aec161feb96b28aa34ac6b 2026-03-09 12:48:53,276 - lava_callback - INFO - Starting async job submit for node 69aec161feb96b28aa34ac6b INFO: 172.20.0.1:40944 - "POST /node/69aec161feb96b28aa34ac6b HTTP/1.0" 202 Accepted 2026-03-09 12:48:53,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:53,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:53,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec161feb96b28aa34ac6b HTTP/1.1" 200 None 2026-03-09 12:48:53,325 - lava_callback - DEBUG - Processing node 69aec161feb96b28aa34ac6b: baseline-arm 2026-03-09 12:48:53,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:53,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec180feb96b28aa34ad22/lava-logs.yaml 2026-03-09 12:48:53,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:53,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:53,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:53,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec180feb96b28aa34ad22/lava_callback.json.gz 2026-03-09 12:48:53,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:53,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:53,821 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aec161feb96b28aa34ac6b/log.txt.gz 2026-03-09 12:48:53,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec180feb96b28aa34ad22 HTTP/1.1" 200 None 2026-03-09 12:48:53,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:53,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:48:53,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:53,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:54,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec180feb96b28aa34ad22 HTTP/1.1" 200 None 2026-03-09 12:48:54,002 - lava_callback - INFO - Completed processing callback for node 69aec180feb96b28aa34ad22 2026-03-09 12:48:54,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:54,223 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec161feb96b28aa34ac6b/lava-logs.yaml 2026-03-09 12:48:54,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:54,234 - lava_callback - INFO - Received callback for node 69aec15efeb96b28aa34ac5d INFO: 172.20.0.1:40948 - "POST /node/69aec15efeb96b28aa34ac5d HTTP/1.0" 202 Accepted 2026-03-09 12:48:54,241 - lava_callback - INFO - Starting async job submit for node 69aec15efeb96b28aa34ac5d 2026-03-09 12:48:54,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:54,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15efeb96b28aa34ac5d HTTP/1.1" 200 None 2026-03-09 12:48:54,288 - lava_callback - DEBUG - Processing node 69aec15efeb96b28aa34ac5d: baseline-arm 2026-03-09 12:48:54,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:54,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec161feb96b28aa34ac6b/lava_callback.json.gz 2026-03-09 12:48:54,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:54,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:54,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec161feb96b28aa34ac6b HTTP/1.1" 200 None 2026-03-09 12:48:54,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:54,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:48:54,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:54,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec161feb96b28aa34ac6b HTTP/1.1" 200 None 2026-03-09 12:48:54,634 - lava_callback - INFO - Completed processing callback for node 69aec161feb96b28aa34ac6b 2026-03-09 12:48:54,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:54,745 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15efeb96b28aa34ac5d/log.txt.gz 2026-03-09 12:48:54,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:55,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:55,057 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15efeb96b28aa34ac5d/lava-logs.yaml 2026-03-09 12:48:55,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:48:55,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:48:55,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec15efeb96b28aa34ac5d/lava_callback.json.gz 2026-03-09 12:48:55,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:55,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec15efeb96b28aa34ac5d HTTP/1.1" 200 None 2026-03-09 12:48:55,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:55,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:48:55,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:48:55,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec15efeb96b28aa34ac5d HTTP/1.1" 200 None 2026-03-09 12:48:55,293 - lava_callback - INFO - Completed processing callback for node 69aec15efeb96b28aa34ac5d INFO: 172.20.0.1:40954 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:49:01,357 - lava_callback - INFO - Received callback for node 69aec184feb96b28aa34ad42 INFO: 172.20.0.1:44988 - "POST /node/69aec184feb96b28aa34ad42 HTTP/1.0" 202 Accepted 2026-03-09 12:49:01,405 - lava_callback - INFO - Starting async job submit for node 69aec184feb96b28aa34ad42 2026-03-09 12:49:01,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:01,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec184feb96b28aa34ad42 HTTP/1.1" 200 None 2026-03-09 12:49:01,447 - lava_callback - DEBUG - Processing node 69aec184feb96b28aa34ad42: baseline-arm-pengutronix 2026-03-09 12:49:01,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:01,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:01,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec184feb96b28aa34ad42/log.txt.gz 2026-03-09 12:49:01,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:01,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:01,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec184feb96b28aa34ad42/lava-logs.yaml 2026-03-09 12:49:01,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:02,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:02,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec184feb96b28aa34ad42/lava_callback.json.gz 2026-03-09 12:49:02,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:02,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec184feb96b28aa34ad42 HTTP/1.1" 200 None 2026-03-09 12:49:02,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:02,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:49:02,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:02,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec184feb96b28aa34ad42 HTTP/1.1" 200 None 2026-03-09 12:49:02,136 - lava_callback - INFO - Completed processing callback for node 69aec184feb96b28aa34ad42 2026-03-09 12:49:03,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:03,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:45004 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:49:12,793 - lava_callback - INFO - Received callback for node 69aec16ffeb96b28aa34acb7 INFO: 172.20.0.1:57770 - "POST /node/69aec16ffeb96b28aa34acb7 HTTP/1.0" 202 Accepted 2026-03-09 12:49:12,799 - lava_callback - INFO - Starting async job submit for node 69aec16ffeb96b28aa34acb7 2026-03-09 12:49:12,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:12,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16ffeb96b28aa34acb7 HTTP/1.1" 200 None 2026-03-09 12:49:12,837 - lava_callback - DEBUG - Processing node 69aec16ffeb96b28aa34acb7: baseline-arm-broonie 2026-03-09 12:49:13,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:13,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:13,174 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec16ffeb96b28aa34acb7/log.txt.gz 2026-03-09 12:49:13,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:13,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:13,493 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec16ffeb96b28aa34acb7/lava-logs.yaml 2026-03-09 12:49:13,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:13,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:13,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec16ffeb96b28aa34acb7/lava_callback.json.gz 2026-03-09 12:49:13,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:13,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec16ffeb96b28aa34acb7 HTTP/1.1" 200 None 2026-03-09 12:49:13,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:13,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:49:13,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:13,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec16ffeb96b28aa34acb7 HTTP/1.1" 200 None 2026-03-09 12:49:13,718 - lava_callback - INFO - Completed processing callback for node 69aec16ffeb96b28aa34acb7 2026-03-09 12:49:14,327 - lava_callback - INFO - Received callback for node 69aec170feb96b28aa34acba INFO: 172.20.0.1:57774 - "POST /node/69aec170feb96b28aa34acba HTTP/1.0" 202 Accepted 2026-03-09 12:49:14,334 - lava_callback - INFO - Starting async job submit for node 69aec170feb96b28aa34acba 2026-03-09 12:49:14,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:14,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec170feb96b28aa34acba HTTP/1.1" 200 None 2026-03-09 12:49:14,371 - lava_callback - DEBUG - Processing node 69aec170feb96b28aa34acba: baseline-arm-broonie 2026-03-09 12:49:14,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:14,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:14,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec170feb96b28aa34acba/log.txt.gz 2026-03-09 12:49:14,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:15,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:15,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec170feb96b28aa34acba/lava-logs.yaml 2026-03-09 12:49:15,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57786 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 12:49:15,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:15,232 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec170feb96b28aa34acba/lava_callback.json.gz 2026-03-09 12:49:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:15,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec170feb96b28aa34acba HTTP/1.1" 200 None 2026-03-09 12:49:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:15,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:49:15,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:15,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec170feb96b28aa34acba HTTP/1.1" 200 None 2026-03-09 12:49:15,319 - lava_callback - INFO - Completed processing callback for node 69aec170feb96b28aa34acba INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:49:21,116 - lava_callback - INFO - Received callback for node 69aec175feb96b28aa34accc INFO: 172.20.0.1:35588 - "POST /node/69aec175feb96b28aa34accc HTTP/1.0" 202 Accepted 2026-03-09 12:49:21,122 - lava_callback - INFO - Starting async job submit for node 69aec175feb96b28aa34accc 2026-03-09 12:49:21,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:21,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec175feb96b28aa34accc HTTP/1.1" 200 None 2026-03-09 12:49:21,160 - lava_callback - DEBUG - Processing node 69aec175feb96b28aa34accc: baseline-arm-clabbe 2026-03-09 12:49:21,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:21,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:21,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec175feb96b28aa34accc/log.txt.gz 2026-03-09 12:49:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:21,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:21,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec175feb96b28aa34accc/lava-logs.yaml 2026-03-09 12:49:21,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:21,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:21,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec175feb96b28aa34accc/lava_callback.json.gz 2026-03-09 12:49:21,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:22,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec175feb96b28aa34accc HTTP/1.1" 200 None 2026-03-09 12:49:22,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:22,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:49:22,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:22,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec175feb96b28aa34accc HTTP/1.1" 200 None 2026-03-09 12:49:22,048 - lava_callback - INFO - Completed processing callback for node 69aec175feb96b28aa34accc INFO: 172.20.0.1:35598 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:49:33,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:33,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48164 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:49:39,112 - lava_callback - INFO - Received callback for node 69aec17efeb96b28aa34ad17 INFO: 172.20.0.1:48170 - "POST /node/69aec17efeb96b28aa34ad17 HTTP/1.0" 202 Accepted 2026-03-09 12:49:39,118 - lava_callback - INFO - Starting async job submit for node 69aec17efeb96b28aa34ad17 2026-03-09 12:49:39,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:39,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17efeb96b28aa34ad17 HTTP/1.1" 200 None 2026-03-09 12:49:39,157 - lava_callback - DEBUG - Processing node 69aec17efeb96b28aa34ad17: baseline-arm-kontron 2026-03-09 12:49:39,296 - lava_callback - INFO - Received callback for node 69aec171feb96b28aa34acbd INFO: 172.20.0.1:48186 - "POST /node/69aec171feb96b28aa34acbd HTTP/1.0" 202 Accepted 2026-03-09 12:49:39,323 - lava_callback - INFO - Starting async job submit for node 69aec171feb96b28aa34acbd 2026-03-09 12:49:39,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:39,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:39,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec171feb96b28aa34acbd HTTP/1.1" 200 None 2026-03-09 12:49:39,379 - lava_callback - DEBUG - Processing node 69aec171feb96b28aa34acbd: baseline-arm-broonie 2026-03-09 12:49:39,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:39,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69aec17efeb96b28aa34ad17/log.txt.gz 2026-03-09 12:49:39,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:39,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:39,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:39,869 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec171feb96b28aa34acbd/log.txt.gz 2026-03-09 12:49:39,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:39,998 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69aec17efeb96b28aa34ad17/lava-logs.yaml 2026-03-09 12:49:40,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:40,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:40,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:40,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69aec17efeb96b28aa34ad17/lava_callback.json.gz 2026-03-09 12:49:40,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:40,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17efeb96b28aa34ad17 HTTP/1.1" 200 None 2026-03-09 12:49:40,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:40,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:49:40,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:40,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:40,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec171feb96b28aa34acbd/lava-logs.yaml 2026-03-09 12:49:40,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:40,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec17efeb96b28aa34ad17 HTTP/1.1" 200 None 2026-03-09 12:49:40,260 - lava_callback - INFO - Completed processing callback for node 69aec17efeb96b28aa34ad17 2026-03-09 12:49:40,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:40,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69aec171feb96b28aa34acbd/lava_callback.json.gz 2026-03-09 12:49:40,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:40,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec171feb96b28aa34acbd HTTP/1.1" 200 None 2026-03-09 12:49:40,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:40,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:49:40,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:40,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec171feb96b28aa34acbd HTTP/1.1" 200 None 2026-03-09 12:49:40,554 - lava_callback - INFO - Completed processing callback for node 69aec171feb96b28aa34acbd INFO: 172.20.0.1:44508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36516 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:49:53,643 - lava_callback - INFO - Received callback for node 69aec182feb96b28aa34ad25 INFO: 172.20.0.1:36530 - "POST /node/69aec182feb96b28aa34ad25 HTTP/1.0" 202 Accepted 2026-03-09 12:49:53,649 - lava_callback - INFO - Starting async job submit for node 69aec182feb96b28aa34ad25 2026-03-09 12:49:53,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:53,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec182feb96b28aa34ad25 HTTP/1.1" 200 None 2026-03-09 12:49:53,689 - lava_callback - DEBUG - Processing node 69aec182feb96b28aa34ad25: baseline-arm-pengutronix 2026-03-09 12:49:53,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:53,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:53,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec182feb96b28aa34ad25/log.txt.gz 2026-03-09 12:49:54,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:54,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:54,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec182feb96b28aa34ad25/lava-logs.yaml 2026-03-09 12:49:54,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:49:54,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:49:54,422 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec182feb96b28aa34ad25/lava_callback.json.gz 2026-03-09 12:49:54,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:54,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec182feb96b28aa34ad25 HTTP/1.1" 200 None 2026-03-09 12:49:54,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:54,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:49:54,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:49:54,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec182feb96b28aa34ad25 HTTP/1.1" 200 None 2026-03-09 12:49:54,605 - lava_callback - INFO - Completed processing callback for node 69aec182feb96b28aa34ad25 INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:50:03,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:03,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58166 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:50:15,094 - lava_callback - INFO - Received callback for node 69aec199feb96b28aa34ad57 INFO: 172.20.0.1:42580 - "POST /node/69aec199feb96b28aa34ad57 HTTP/1.0" 202 Accepted 2026-03-09 12:50:15,100 - lava_callback - INFO - Starting async job submit for node 69aec199feb96b28aa34ad57 2026-03-09 12:50:15,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:15,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec199feb96b28aa34ad57 HTTP/1.1" 200 None 2026-03-09 12:50:15,140 - lava_callback - DEBUG - Processing node 69aec199feb96b28aa34ad57: ltp-dio INFO: 172.20.0.1:42594 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 12:50:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:50:15,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:50:15,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69aec199feb96b28aa34ad57/log.txt.gz 2026-03-09 12:50:15,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:50:16,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:50:16,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69aec199feb96b28aa34ad57/lava-logs.yaml 2026-03-09 12:50:16,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:50:16,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:50:16,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69aec199feb96b28aa34ad57/lava_callback.json.gz 2026-03-09 12:50:16,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:16,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec199feb96b28aa34ad57 HTTP/1.1" 200 None 2026-03-09 12:50:16,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:16,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:50:16,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:16,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec199feb96b28aa34ad57 HTTP/1.1" 200 None 2026-03-09 12:50:16,432 - lava_callback - INFO - Completed processing callback for node 69aec199feb96b28aa34ad57 INFO: 172.20.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60296 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:50:33,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:33,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:50:56,152 - lava_callback - INFO - Received callback for node 69aec176feb96b28aa34acd0 INFO: 172.20.0.1:48448 - "POST /node/69aec176feb96b28aa34acd0 HTTP/1.0" 202 Accepted 2026-03-09 12:50:56,161 - lava_callback - INFO - Starting async job submit for node 69aec176feb96b28aa34acd0 2026-03-09 12:50:56,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:56,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec176feb96b28aa34acd0 HTTP/1.1" 200 None 2026-03-09 12:50:56,241 - lava_callback - DEBUG - Processing node 69aec176feb96b28aa34acd0: baseline-arm-clabbe INFO: 172.20.0.1:48458 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:50:56,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:50:56,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:50:56,926 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec176feb96b28aa34acd0/log.txt.gz 2026-03-09 12:50:57,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:50:57,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:50:57,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec176feb96b28aa34acd0/lava-logs.yaml 2026-03-09 12:50:57,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:50:58,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:50:58,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec176feb96b28aa34acd0/lava_callback.json.gz 2026-03-09 12:50:58,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:58,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec176feb96b28aa34acd0 HTTP/1.1" 200 None 2026-03-09 12:50:58,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:58,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:50:58,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:50:58,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec176feb96b28aa34acd0 HTTP/1.1" 200 None 2026-03-09 12:50:58,334 - lava_callback - INFO - Completed processing callback for node 69aec176feb96b28aa34acd0 2026-03-09 12:51:03,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:51:03,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:51:51,290 - lava_callback - INFO - Received callback for node 69ac1f5840deb775998f535b INFO: 172.20.0.1:32864 - "POST /node/69ac1f5840deb775998f535b HTTP/1.0" 202 Accepted 2026-03-09 12:51:51,299 - lava_callback - INFO - Starting async job submit for node 69ac1f5840deb775998f535b 2026-03-09 12:51:51,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:51:51,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1f5840deb775998f535b HTTP/1.1" 200 None 2026-03-09 12:51:51,330 - lava_callback - DEBUG - Processing node 69ac1f5840deb775998f535b: baseline-arm-baylibre 2026-03-09 12:51:51,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac1f5840deb775998f535b 2026-03-09 12:51:51,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:51:51,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1f5840deb775998f535b HTTP/1.1" 200 None 2026-03-09 12:51:51,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:51:51,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:51:51,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:51:51,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac1f5840deb775998f535b HTTP/1.1" 200 None 2026-03-09 12:51:51,442 - lava_callback - ERROR - Error processing callback for node 69ac1f5840deb775998f535b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60338 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:52:27,234 - lava_callback - INFO - Received callback for node 69aec17afeb96b28aa34acdc INFO: 172.20.0.1:60350 - "POST /node/69aec17afeb96b28aa34acdc HTTP/1.0" 202 Accepted 2026-03-09 12:52:27,241 - lava_callback - INFO - Starting async job submit for node 69aec17afeb96b28aa34acdc 2026-03-09 12:52:27,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:27,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17afeb96b28aa34acdc HTTP/1.1" 200 None 2026-03-09 12:52:27,298 - lava_callback - DEBUG - Processing node 69aec17afeb96b28aa34acdc: baseline-arm-clabbe 2026-03-09 12:52:27,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:52:27,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:52:27,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec17afeb96b28aa34acdc/log.txt.gz 2026-03-09 12:52:27,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:52:28,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:52:28,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec17afeb96b28aa34acdc/lava-logs.yaml 2026-03-09 12:52:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:52:28,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:52:28,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec17afeb96b28aa34acdc/lava_callback.json.gz 2026-03-09 12:52:28,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:28,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17afeb96b28aa34acdc HTTP/1.1" 200 None 2026-03-09 12:52:28,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:28,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:52:28,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:28,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec17afeb96b28aa34acdc HTTP/1.1" 200 None 2026-03-09 12:52:28,442 - lava_callback - INFO - Completed processing callback for node 69aec17afeb96b28aa34acdc 2026-03-09 12:52:31,205 - lava_callback - INFO - Received callback for node 69ac1f8940deb775998f5372 INFO: 172.20.0.1:41820 - "POST /node/69ac1f8940deb775998f5372 HTTP/1.0" 202 Accepted 2026-03-09 12:52:31,212 - lava_callback - INFO - Starting async job submit for node 69ac1f8940deb775998f5372 2026-03-09 12:52:31,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:31,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1f8940deb775998f5372 HTTP/1.1" 200 None 2026-03-09 12:52:31,252 - lava_callback - DEBUG - Processing node 69ac1f8940deb775998f5372: baseline-arm-baylibre 2026-03-09 12:52:31,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac1f8940deb775998f5372 2026-03-09 12:52:31,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:31,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1f8940deb775998f5372 HTTP/1.1" 200 None 2026-03-09 12:52:31,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:31,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:52:31,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:31,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac1f8940deb775998f5372 HTTP/1.1" 200 None 2026-03-09 12:52:31,328 - lava_callback - ERROR - Error processing callback for node 69ac1f8940deb775998f5372: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 12:52:33,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:33,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42624 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:52:56,155 - lava_callback - INFO - Received callback for node 69aec288feb96b28aa34aed5 INFO: 172.20.0.1:42630 - "POST /node/69aec288feb96b28aa34aed5 HTTP/1.0" 202 Accepted 2026-03-09 12:52:56,161 - lava_callback - INFO - Starting async job submit for node 69aec288feb96b28aa34aed5 2026-03-09 12:52:56,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:56,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec288feb96b28aa34aed5 HTTP/1.1" 200 None 2026-03-09 12:52:56,184 - lava_callback - DEBUG - Processing node 69aec288feb96b28aa34aed5: baseline-arm 2026-03-09 12:52:56,193 - lava_callback - WARNING - Failed to upload log 2026-03-09 12:52:56,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:52:56,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:52:56,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec288feb96b28aa34aed5/lava-logs.yaml 2026-03-09 12:52:56,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42646 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:52:56,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:52:56,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec288feb96b28aa34aed5/lava_callback.json.gz 2026-03-09 12:52:56,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:56,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec288feb96b28aa34aed5 HTTP/1.1" 200 None 2026-03-09 12:52:56,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:56,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:52:56,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:52:56,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec288feb96b28aa34aed5 HTTP/1.1" 200 None 2026-03-09 12:52:56,678 - lava_callback - INFO - Completed processing callback for node 69aec288feb96b28aa34aed5 2026-03-09 12:53:02,175 - lava_callback - INFO - Received callback for node 69aec19ffeb96b28aa34ad8c INFO: 172.20.0.1:46626 - "POST /node/69aec19ffeb96b28aa34ad8c HTTP/1.0" 202 Accepted 2026-03-09 12:53:02,187 - lava_callback - INFO - Starting async job submit for node 69aec19ffeb96b28aa34ad8c 2026-03-09 12:53:02,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:02,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec19ffeb96b28aa34ad8c HTTP/1.1" 200 None 2026-03-09 12:53:02,283 - lava_callback - DEBUG - Processing node 69aec19ffeb96b28aa34ad8c: ltp-syscalls 2026-03-09 12:53:03,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:53:03,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:53:03,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69aec19ffeb96b28aa34ad8c/log.txt.gz 2026-03-09 12:53:03,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:03,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-09 12:53:04,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:53:04,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:53:04,262 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69aec19ffeb96b28aa34ad8c/lava-logs.yaml 2026-03-09 12:53:04,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:53:04,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:53:04,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69aec19ffeb96b28aa34ad8c/lava_callback.json.gz 2026-03-09 12:53:04,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec19ffeb96b28aa34ad8c HTTP/1.1" 200 None 2026-03-09 12:53:04,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:04,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:53:04,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:04,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec19ffeb96b28aa34ad8c HTTP/1.1" 200 None 2026-03-09 12:53:04,800 - lava_callback - INFO - Completed processing callback for node 69aec19ffeb96b28aa34ad8c INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:53:11,293 - lava_callback - INFO - Received callback for node 69ac1fae40deb775998f5382 INFO: 172.20.0.1:56130 - "POST /node/69ac1fae40deb775998f5382 HTTP/1.0" 202 Accepted 2026-03-09 12:53:11,302 - lava_callback - INFO - Starting async job submit for node 69ac1fae40deb775998f5382 2026-03-09 12:53:11,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:11,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1fae40deb775998f5382 HTTP/1.1" 200 None 2026-03-09 12:53:11,352 - lava_callback - DEBUG - Processing node 69ac1fae40deb775998f5382: baseline-arm-baylibre 2026-03-09 12:53:11,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac1fae40deb775998f5382 2026-03-09 12:53:11,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:11,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1fae40deb775998f5382 HTTP/1.1" 200 None 2026-03-09 12:53:11,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:11,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:53:11,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:11,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac1fae40deb775998f5382 HTTP/1.1" 200 None 2026-03-09 12:53:11,411 - lava_callback - ERROR - Error processing callback for node 69ac1fae40deb775998f5382: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49824 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:53:33,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:33,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47858 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:53:51,242 - lava_callback - INFO - Received callback for node 69ac1fd240deb775998f53a0 INFO: 172.20.0.1:42326 - "POST /node/69ac1fd240deb775998f53a0 HTTP/1.0" 202 Accepted 2026-03-09 12:53:51,249 - lava_callback - INFO - Starting async job submit for node 69ac1fd240deb775998f53a0 2026-03-09 12:53:51,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:51,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1fd240deb775998f53a0 HTTP/1.1" 200 None 2026-03-09 12:53:51,265 - lava_callback - DEBUG - Processing node 69ac1fd240deb775998f53a0: baseline-arm-baylibre 2026-03-09 12:53:51,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac1fd240deb775998f53a0 2026-03-09 12:53:51,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:51,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1fd240deb775998f53a0 HTTP/1.1" 200 None 2026-03-09 12:53:51,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:51,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:53:51,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:53:51,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac1fd240deb775998f53a0 HTTP/1.1" 200 None 2026-03-09 12:53:51,322 - lava_callback - ERROR - Error processing callback for node 69ac1fd240deb775998f53a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42350 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:54:06,355 - lava_callback - INFO - Received callback for node 69aec17bfeb96b28aa34ad11 INFO: 172.20.0.1:43558 - "POST /node/69aec17bfeb96b28aa34ad11 HTTP/1.0" 202 Accepted 2026-03-09 12:54:06,361 - lava_callback - INFO - Starting async job submit for node 69aec17bfeb96b28aa34ad11 2026-03-09 12:54:06,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:06,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17bfeb96b28aa34ad11 HTTP/1.1" 200 None 2026-03-09 12:54:06,398 - lava_callback - DEBUG - Processing node 69aec17bfeb96b28aa34ad11: baseline-arm-clabbe INFO: 172.20.0.1:43574 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:54:06,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:54:06,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:54:06,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec17bfeb96b28aa34ad11/log.txt.gz 2026-03-09 12:54:06,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:54:07,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:54:07,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec17bfeb96b28aa34ad11/lava-logs.yaml 2026-03-09 12:54:07,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:54:07,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:54:07,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69aec17bfeb96b28aa34ad11/lava_callback.json.gz 2026-03-09 12:54:07,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:07,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec17bfeb96b28aa34ad11 HTTP/1.1" 200 None 2026-03-09 12:54:07,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:07,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:54:07,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:07,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec17bfeb96b28aa34ad11 HTTP/1.1" 200 None 2026-03-09 12:54:07,334 - lava_callback - INFO - Completed processing callback for node 69aec17bfeb96b28aa34ad11 INFO: 172.20.0.1:55940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:54:31,324 - lava_callback - INFO - Received callback for node 69ac1ff540deb775998f53b4 INFO: 172.20.0.1:59666 - "POST /node/69ac1ff540deb775998f53b4 HTTP/1.0" 202 Accepted 2026-03-09 12:54:31,329 - lava_callback - INFO - Starting async job submit for node 69ac1ff540deb775998f53b4 2026-03-09 12:54:31,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:31,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1ff540deb775998f53b4 HTTP/1.1" 200 None 2026-03-09 12:54:31,348 - lava_callback - DEBUG - Processing node 69ac1ff540deb775998f53b4: baseline-arm-baylibre 2026-03-09 12:54:31,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac1ff540deb775998f53b4 2026-03-09 12:54:31,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:31,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac1ff540deb775998f53b4 HTTP/1.1" 200 None 2026-03-09 12:54:31,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:31,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:54:31,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:31,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac1ff540deb775998f53b4 HTTP/1.1" 200 None 2026-03-09 12:54:31,451 - lava_callback - ERROR - Error processing callback for node 69ac1ff540deb775998f53b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 12:54:34,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:54:34,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59402 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:56:07,292 - lava_callback - INFO - Received callback for node 69ac206440deb775998f53e4 INFO: 172.20.0.1:59410 - "POST /node/69ac206440deb775998f53e4 HTTP/1.0" 202 Accepted 2026-03-09 12:56:07,298 - lava_callback - INFO - Starting async job submit for node 69ac206440deb775998f53e4 2026-03-09 12:56:07,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:07,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac206440deb775998f53e4 HTTP/1.1" 200 None 2026-03-09 12:56:07,314 - lava_callback - DEBUG - Processing node 69ac206440deb775998f53e4: baseline-arm-clabbe 2026-03-09 12:56:07,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac206440deb775998f53e4 2026-03-09 12:56:07,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:07,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac206440deb775998f53e4 HTTP/1.1" 200 None 2026-03-09 12:56:07,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:07,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:56:07,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:07,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac206440deb775998f53e4 HTTP/1.1" 200 None 2026-03-09 12:56:07,366 - lava_callback - ERROR - Error processing callback for node 69ac206440deb775998f53e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55212 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:56:47,286 - lava_callback - INFO - Received callback for node 69ac208940deb775998f5407 INFO: 172.20.0.1:55214 - "POST /node/69ac208940deb775998f5407 HTTP/1.0" 202 Accepted 2026-03-09 12:56:47,291 - lava_callback - INFO - Starting async job submit for node 69ac208940deb775998f5407 2026-03-09 12:56:47,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:47,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac208940deb775998f5407 HTTP/1.1" 200 None 2026-03-09 12:56:47,312 - lava_callback - DEBUG - Processing node 69ac208940deb775998f5407: baseline-arm-clabbe 2026-03-09 12:56:47,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac208940deb775998f5407 2026-03-09 12:56:47,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:47,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac208940deb775998f5407 HTTP/1.1" 200 None 2026-03-09 12:56:47,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:47,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:56:47,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:56:47,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac208940deb775998f5407 HTTP/1.1" 200 None 2026-03-09 12:56:47,380 - lava_callback - ERROR - Error processing callback for node 69ac208940deb775998f5407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57238 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:57:27,366 - lava_callback - INFO - Received callback for node 69ac20b040deb775998f541d INFO: 172.20.0.1:57246 - "POST /node/69ac20b040deb775998f541d HTTP/1.0" 202 Accepted 2026-03-09 12:57:27,371 - lava_callback - INFO - Starting async job submit for node 69ac20b040deb775998f541d 2026-03-09 12:57:27,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:57:27,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac20b040deb775998f541d HTTP/1.1" 200 None 2026-03-09 12:57:27,387 - lava_callback - DEBUG - Processing node 69ac20b040deb775998f541d: baseline-arm-clabbe 2026-03-09 12:57:27,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac20b040deb775998f541d 2026-03-09 12:57:27,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:57:27,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac20b040deb775998f541d HTTP/1.1" 200 None 2026-03-09 12:57:27,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:57:27,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e34efa461f55e59cdb7 HTTP/1.1" 200 None 2026-03-09 12:57:27,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:57:27,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac20b040deb775998f541d HTTP/1.1" 200 None 2026-03-09 12:57:27,444 - lava_callback - ERROR - Error processing callback for node 69ac20b040deb775998f541d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39900 - "GET / HTTP/1.0" 200 OK 2026-03-09 12:59:47,037 - lava_callback - INFO - Received callback for node 69aec3d1feb96b28aa34b098 INFO: 172.20.0.1:39916 - "POST /node/69aec3d1feb96b28aa34b098 HTTP/1.0" 202 Accepted 2026-03-09 12:59:47,043 - lava_callback - INFO - Starting async job submit for node 69aec3d1feb96b28aa34b098 2026-03-09 12:59:47,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:59:47,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec3d1feb96b28aa34b098 HTTP/1.1" 200 None 2026-03-09 12:59:47,095 - lava_callback - DEBUG - Processing node 69aec3d1feb96b28aa34b098: baseline-arm-pengutronix 2026-03-09 12:59:47,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:59:47,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:59:47,399 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec3d1feb96b28aa34b098/log.txt.gz 2026-03-09 12:59:47,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:59:47,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:59:47,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec3d1feb96b28aa34b098/lava-logs.yaml 2026-03-09 12:59:47,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 12:59:47,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 12:59:47,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec3d1feb96b28aa34b098/lava_callback.json.gz 2026-03-09 12:59:47,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:59:47,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec3d1feb96b28aa34b098 HTTP/1.1" 200 None 2026-03-09 12:59:47,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:59:47,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 12:59:47,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 12:59:48,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec3d1feb96b28aa34b098 HTTP/1.1" 200 None 2026-03-09 12:59:48,102 - lava_callback - INFO - Completed processing callback for node 69aec3d1feb96b28aa34b098 INFO: 172.20.0.1:51260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51262 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:00:04,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:00:04,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41896 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:03:41,513 - lava_callback - INFO - Received callback for node 69aec527feb96b28aa34b269 INFO: 172.20.0.1:50402 - "POST /node/69aec527feb96b28aa34b269 HTTP/1.0" 202 Accepted 2026-03-09 13:03:41,519 - lava_callback - INFO - Starting async job submit for node 69aec527feb96b28aa34b269 2026-03-09 13:03:41,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:03:41,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec527feb96b28aa34b269 HTTP/1.1" 200 None 2026-03-09 13:03:41,540 - lava_callback - DEBUG - Processing node 69aec527feb96b28aa34b269: baseline-arm 2026-03-09 13:03:41,546 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:03:41,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:03:41,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:03:41,694 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec527feb96b28aa34b269/lava-logs.yaml 2026-03-09 13:03:41,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:03:41,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:03:41,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec527feb96b28aa34b269/lava_callback.json.gz 2026-03-09 13:03:41,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:03:41,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec527feb96b28aa34b269 HTTP/1.1" 200 None 2026-03-09 13:03:41,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:03:41,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 13:03:41,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:03:41,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec527feb96b28aa34b269 HTTP/1.1" 200 None 2026-03-09 13:03:41,886 - lava_callback - INFO - Completed processing callback for node 69aec527feb96b28aa34b269 INFO: 172.20.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38282 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:04:04,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:04:04,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57482 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:05:28,316 - lava_callback - INFO - Received callback for node 69aec160feb96b28aa34ac66 INFO: 172.20.0.1:57498 - "POST /node/69aec160feb96b28aa34ac66 HTTP/1.0" 202 Accepted 2026-03-09 13:05:28,325 - lava_callback - INFO - Starting async job submit for node 69aec160feb96b28aa34ac66 2026-03-09 13:05:28,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:05:28,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec160feb96b28aa34ac66 HTTP/1.1" 200 None 2026-03-09 13:05:28,460 - lava_callback - DEBUG - Processing node 69aec160feb96b28aa34ac66: baseline-arm 2026-03-09 13:05:29,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:05:29,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:05:29,266 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aec160feb96b28aa34ac66/log.txt.gz 2026-03-09 13:05:29,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:05:29,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:05:29,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aec160feb96b28aa34ac66/lava-logs.yaml 2026-03-09 13:05:29,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:05:30,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:05:30,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aec160feb96b28aa34ac66/lava_callback.json.gz DEBUG: Setup failed for 69aec160feb96b28aa34ac66. Transitting job node result: incomplete -> fail 2026-03-09 13:05:30,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:05:30,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec160feb96b28aa34ac66 HTTP/1.1" 200 None 2026-03-09 13:05:30,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:05:30,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 13:05:30,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:05:30,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec160feb96b28aa34ac66 HTTP/1.1" 200 None 2026-03-09 13:05:30,409 - lava_callback - INFO - Completed processing callback for node 69aec160feb96b28aa34ac66 2026-03-09 13:05:34,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:05:34,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54396 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 13:07:15,607 - lava_callback - INFO - Received callback for node 69aec183feb96b28aa34ad29 INFO: 172.20.0.1:54400 - "POST /node/69aec183feb96b28aa34ad29 HTTP/1.0" 202 Accepted 2026-03-09 13:07:15,658 - lava_callback - INFO - Starting async job submit for node 69aec183feb96b28aa34ad29 2026-03-09 13:07:15,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:07:15,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec183feb96b28aa34ad29 HTTP/1.1" 200 None 2026-03-09 13:07:15,705 - lava_callback - DEBUG - Processing node 69aec183feb96b28aa34ad29: baseline-arm-pengutronix 2026-03-09 13:07:15,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:07:15,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:07:15,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec183feb96b28aa34ad29/log.txt.gz 2026-03-09 13:07:16,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:07:16,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:07:16,201 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec183feb96b28aa34ad29/lava-logs.yaml 2026-03-09 13:07:16,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:07:16,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:07:16,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec183feb96b28aa34ad29/lava_callback.json.gz DEBUG: Setup failed for 69aec183feb96b28aa34ad29. Transitting job node result: incomplete -> fail 2026-03-09 13:07:16,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:07:16,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec183feb96b28aa34ad29 HTTP/1.1" 200 None 2026-03-09 13:07:16,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:07:16,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 13:07:16,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:07:16,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec183feb96b28aa34ad29 HTTP/1.1" 200 None 2026-03-09 13:07:16,491 - lava_callback - INFO - Completed processing callback for node 69aec183feb96b28aa34ad29 INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55222 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:07:34,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:07:34,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48236 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:08:52,204 - lava_callback - INFO - Received callback for node 69ac235c40deb775998f54ca INFO: 172.20.0.1:34454 - "POST /node/69ac235c40deb775998f54ca HTTP/1.0" 202 Accepted 2026-03-09 13:08:52,210 - lava_callback - INFO - Starting async job submit for node 69ac235c40deb775998f54ca 2026-03-09 13:08:52,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:08:52,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac235c40deb775998f54ca HTTP/1.1" 200 None 2026-03-09 13:08:52,236 - lava_callback - DEBUG - Processing node 69ac235c40deb775998f54ca: baseline-arm64-baylibre 2026-03-09 13:08:52,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac235c40deb775998f54ca 2026-03-09 13:08:52,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:08:52,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac235c40deb775998f54ca HTTP/1.1" 200 None 2026-03-09 13:08:52,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:08:52,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-09 13:08:52,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:08:52,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac235c40deb775998f54ca HTTP/1.1" 200 None 2026-03-09 13:08:52,301 - lava_callback - ERROR - Error processing callback for node 69ac235c40deb775998f54ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46980 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:10:12,185 - lava_callback - INFO - Received callback for node 69ac23a740deb775998f54de INFO: 172.20.0.1:48392 - "POST /node/69ac23a740deb775998f54de HTTP/1.0" 202 Accepted 2026-03-09 13:10:12,191 - lava_callback - INFO - Starting async job submit for node 69ac23a740deb775998f54de 2026-03-09 13:10:12,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:10:12,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac23a740deb775998f54de HTTP/1.1" 200 None 2026-03-09 13:10:12,206 - lava_callback - DEBUG - Processing node 69ac23a740deb775998f54de: baseline-arm64-baylibre 2026-03-09 13:10:12,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac23a740deb775998f54de 2026-03-09 13:10:12,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:10:12,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac23a740deb775998f54de HTTP/1.1" 200 None 2026-03-09 13:10:12,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:10:12,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-09 13:10:12,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:10:12,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac23a740deb775998f54de HTTP/1.1" 200 None 2026-03-09 13:10:12,272 - lava_callback - ERROR - Error processing callback for node 69ac23a740deb775998f54de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32844 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:11:32,276 - lava_callback - INFO - Received callback for node 69ac23f240deb775998f54f5 INFO: 172.20.0.1:47318 - "POST /node/69ac23f240deb775998f54f5 HTTP/1.0" 202 Accepted 2026-03-09 13:11:32,281 - lava_callback - INFO - Starting async job submit for node 69ac23f240deb775998f54f5 2026-03-09 13:11:32,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:11:32,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac23f240deb775998f54f5 HTTP/1.1" 200 None 2026-03-09 13:11:32,310 - lava_callback - DEBUG - Processing node 69ac23f240deb775998f54f5: baseline-arm64-baylibre 2026-03-09 13:11:32,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac23f240deb775998f54f5 2026-03-09 13:11:32,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:11:32,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac23f240deb775998f54f5 HTTP/1.1" 200 None 2026-03-09 13:11:32,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:11:32,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-09 13:11:32,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:11:32,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac23f240deb775998f54f5 HTTP/1.1" 200 None 2026-03-09 13:11:32,373 - lava_callback - ERROR - Error processing callback for node 69ac23f240deb775998f54f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40716 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:12:52,322 - lava_callback - INFO - Received callback for node 69ac244140deb775998f5515 INFO: 172.20.0.1:58940 - "POST /node/69ac244140deb775998f5515 HTTP/1.0" 202 Accepted 2026-03-09 13:12:52,330 - lava_callback - INFO - Starting async job submit for node 69ac244140deb775998f5515 2026-03-09 13:12:52,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:12:52,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac244140deb775998f5515 HTTP/1.1" 200 None 2026-03-09 13:12:52,349 - lava_callback - DEBUG - Processing node 69ac244140deb775998f5515: baseline-arm64-baylibre 2026-03-09 13:12:52,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac244140deb775998f5515 2026-03-09 13:12:52,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:12:52,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac244140deb775998f5515 HTTP/1.1" 200 None 2026-03-09 13:12:52,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:12:52,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-09 13:12:52,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:12:52,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac244140deb775998f5515 HTTP/1.1" 200 None 2026-03-09 13:12:52,471 - lava_callback - ERROR - Error processing callback for node 69ac244140deb775998f5515: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:13:52,361 - lava_callback - INFO - Received callback for node 69ac248a40deb775998f5536 INFO: 172.20.0.1:40416 - "POST /node/69ac248a40deb775998f5536 HTTP/1.0" 202 Accepted 2026-03-09 13:13:52,370 - lava_callback - INFO - Starting async job submit for node 69ac248a40deb775998f5536 2026-03-09 13:13:52,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:13:52,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac248a40deb775998f5536 HTTP/1.1" 200 None 2026-03-09 13:13:52,389 - lava_callback - DEBUG - Processing node 69ac248a40deb775998f5536: baseline-arm64-baylibre 2026-03-09 13:13:52,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac248a40deb775998f5536 2026-03-09 13:13:52,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:13:52,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac248a40deb775998f5536 HTTP/1.1" 200 None 2026-03-09 13:13:52,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:13:52,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-09 13:13:52,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:13:52,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac248a40deb775998f5536 HTTP/1.1" 200 None 2026-03-09 13:13:52,461 - lava_callback - ERROR - Error processing callback for node 69ac248a40deb775998f5536: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:15:28,193 - lava_callback - INFO - Received callback for node 69ac24dc40deb775998f5557 INFO: 172.20.0.1:60454 - "POST /node/69ac24dc40deb775998f5557 HTTP/1.0" 202 Accepted 2026-03-09 13:15:28,199 - lava_callback - INFO - Starting async job submit for node 69ac24dc40deb775998f5557 2026-03-09 13:15:28,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:15:28,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac24dc40deb775998f5557 HTTP/1.1" 200 None 2026-03-09 13:15:28,220 - lava_callback - DEBUG - Processing node 69ac24dc40deb775998f5557: baseline-arm64-clabbe 2026-03-09 13:15:28,221 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac24dc40deb775998f5557 2026-03-09 13:15:28,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:15:28,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac24dc40deb775998f5557 HTTP/1.1" 200 None 2026-03-09 13:15:28,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:15:28,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-09 13:15:28,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:15:28,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac24dc40deb775998f5557 HTTP/1.1" 200 None 2026-03-09 13:15:28,279 - lava_callback - ERROR - Error processing callback for node 69ac24dc40deb775998f5557: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56070 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:16:32,560 - lava_callback - INFO - Received callback for node 69ac252040deb775998f556c INFO: 172.20.0.1:46390 - "POST /node/69ac252040deb775998f556c HTTP/1.0" 202 Accepted 2026-03-09 13:16:32,566 - lava_callback - INFO - Starting async job submit for node 69ac252040deb775998f556c 2026-03-09 13:16:32,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:16:32,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac252040deb775998f556c HTTP/1.1" 200 None 2026-03-09 13:16:32,586 - lava_callback - DEBUG - Processing node 69ac252040deb775998f556c: baseline-arm64-baylibre 2026-03-09 13:16:32,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac252040deb775998f556c 2026-03-09 13:16:32,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:16:32,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac252040deb775998f556c HTTP/1.1" 200 None 2026-03-09 13:16:32,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:16:32,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-09 13:16:32,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:16:32,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac252040deb775998f556c HTTP/1.1" 200 None 2026-03-09 13:16:32,663 - lava_callback - ERROR - Error processing callback for node 69ac252040deb775998f556c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44514 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:17:28,256 - lava_callback - INFO - Received callback for node 69ac256540deb775998f5583 INFO: 172.20.0.1:44520 - "POST /node/69ac256540deb775998f5583 HTTP/1.0" 202 Accepted 2026-03-09 13:17:28,266 - lava_callback - INFO - Starting async job submit for node 69ac256540deb775998f5583 2026-03-09 13:17:28,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:17:28,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac256540deb775998f5583 HTTP/1.1" 200 None 2026-03-09 13:17:28,285 - lava_callback - DEBUG - Processing node 69ac256540deb775998f5583: baseline-arm-clabbe 2026-03-09 13:17:28,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac256540deb775998f5583 2026-03-09 13:17:28,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:17:28,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac256540deb775998f5583 HTTP/1.1" 200 None 2026-03-09 13:17:28,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:17:28,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-09 13:17:28,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:17:28,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac256540deb775998f5583 HTTP/1.1" 200 None 2026-03-09 13:17:28,384 - lava_callback - ERROR - Error processing callback for node 69ac256540deb775998f5583: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54146 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:18:00,886 - lava_callback - INFO - Received callback for node 69aec872feb96b28aa34b631 INFO: 172.20.0.1:56514 - "POST /node/69aec872feb96b28aa34b631 HTTP/1.0" 202 Accepted 2026-03-09 13:18:00,892 - lava_callback - INFO - Starting async job submit for node 69aec872feb96b28aa34b631 2026-03-09 13:18:00,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:00,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec872feb96b28aa34b631 HTTP/1.1" 200 None 2026-03-09 13:18:00,928 - lava_callback - DEBUG - Processing node 69aec872feb96b28aa34b631: baseline-arm64 2026-03-09 13:18:01,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:01,118 - lava_callback - INFO - Received callback for node 69aec873feb96b28aa34b634 INFO: 172.20.0.1:56524 - "POST /node/69aec873feb96b28aa34b634 HTTP/1.0" 202 Accepted 2026-03-09 13:18:01,127 - lava_callback - INFO - Starting async job submit for node 69aec873feb96b28aa34b634 2026-03-09 13:18:01,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:01,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec873feb96b28aa34b634 HTTP/1.1" 200 None 2026-03-09 13:18:01,160 - lava_callback - DEBUG - Processing node 69aec873feb96b28aa34b634: baseline-arm64 2026-03-09 13:18:01,167 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:18:01,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:01,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:01,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec872feb96b28aa34b631/log.txt.gz 2026-03-09 13:18:01,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:01,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:01,375 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec873feb96b28aa34b634/lava-logs.yaml 2026-03-09 13:18:01,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:01,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:01,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec873feb96b28aa34b634/lava_callback.json.gz 2026-03-09 13:18:01,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:01,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec873feb96b28aa34b634 HTTP/1.1" 200 None 2026-03-09 13:18:01,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:01,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:01,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:01,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:01,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec873feb96b28aa34b634 HTTP/1.1" 200 None 2026-03-09 13:18:01,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec872feb96b28aa34b631/lava-logs.yaml 2026-03-09 13:18:01,665 - lava_callback - INFO - Completed processing callback for node 69aec873feb96b28aa34b634 2026-03-09 13:18:01,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:01,681 - lava_callback - INFO - Received callback for node 69aec874feb96b28aa34b637 INFO: 172.20.0.1:56528 - "POST /node/69aec874feb96b28aa34b637 HTTP/1.0" 202 Accepted 2026-03-09 13:18:01,693 - lava_callback - INFO - Starting async job submit for node 69aec874feb96b28aa34b637 2026-03-09 13:18:01,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:01,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec874feb96b28aa34b637 HTTP/1.1" 200 None 2026-03-09 13:18:01,740 - lava_callback - DEBUG - Processing node 69aec874feb96b28aa34b637: baseline-arm64 2026-03-09 13:18:01,750 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:18:01,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:02,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:02,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec872feb96b28aa34b631/lava_callback.json.gz 2026-03-09 13:18:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:02,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec872feb96b28aa34b631 HTTP/1.1" 200 None 2026-03-09 13:18:02,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:02,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:02,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:02,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:02,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec874feb96b28aa34b637/lava-logs.yaml 2026-03-09 13:18:02,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:02,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec872feb96b28aa34b631 HTTP/1.1" 200 None 2026-03-09 13:18:02,168 - lava_callback - INFO - Completed processing callback for node 69aec872feb96b28aa34b631 2026-03-09 13:18:02,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:02,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec874feb96b28aa34b637/lava_callback.json.gz 2026-03-09 13:18:02,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:02,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec874feb96b28aa34b637 HTTP/1.1" 200 None 2026-03-09 13:18:02,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:02,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:02,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:02,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec874feb96b28aa34b637 HTTP/1.1" 200 None 2026-03-09 13:18:02,427 - lava_callback - INFO - Completed processing callback for node 69aec874feb96b28aa34b637 2026-03-09 13:18:04,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:04,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56532 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:18:08,272 - lava_callback - INFO - Received callback for node 69ac258940deb775998f559a INFO: 172.20.0.1:56542 - "POST /node/69ac258940deb775998f559a HTTP/1.0" 202 Accepted 2026-03-09 13:18:08,278 - lava_callback - INFO - Starting async job submit for node 69ac258940deb775998f559a 2026-03-09 13:18:08,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:08,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac258940deb775998f559a HTTP/1.1" 200 None 2026-03-09 13:18:08,296 - lava_callback - DEBUG - Processing node 69ac258940deb775998f559a: baseline-arm-clabbe 2026-03-09 13:18:08,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac258940deb775998f559a 2026-03-09 13:18:08,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:08,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac258940deb775998f559a HTTP/1.1" 200 None 2026-03-09 13:18:08,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:08,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-09 13:18:08,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:08,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac258940deb775998f559a HTTP/1.1" 200 None 2026-03-09 13:18:08,374 - lava_callback - ERROR - Error processing callback for node 69ac258940deb775998f559a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55232 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:18:27,478 - lava_callback - INFO - Received callback for node 69aec877feb96b28aa34b640 INFO: 172.20.0.1:55240 - "POST /node/69aec877feb96b28aa34b640 HTTP/1.0" 202 Accepted 2026-03-09 13:18:27,491 - lava_callback - INFO - Starting async job submit for node 69aec877feb96b28aa34b640 2026-03-09 13:18:27,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:27,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec877feb96b28aa34b640 HTTP/1.1" 200 None 2026-03-09 13:18:27,548 - lava_callback - DEBUG - Processing node 69aec877feb96b28aa34b640: baseline-arm64 2026-03-09 13:18:27,607 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:18:27,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:27,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:27,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec877feb96b28aa34b640/lava-logs.yaml 2026-03-09 13:18:27,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:27,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:27,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec877feb96b28aa34b640/lava_callback.json.gz 2026-03-09 13:18:27,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:27,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec877feb96b28aa34b640 HTTP/1.1" 200 None 2026-03-09 13:18:27,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:27,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:27,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:28,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec877feb96b28aa34b640 HTTP/1.1" 200 None 2026-03-09 13:18:28,089 - lava_callback - INFO - Completed processing callback for node 69aec877feb96b28aa34b640 2026-03-09 13:18:28,921 - lava_callback - INFO - Received callback for node 69aec88ffeb96b28aa34b6be INFO: 172.20.0.1:55244 - "POST /node/69aec88ffeb96b28aa34b6be HTTP/1.0" 202 Accepted 2026-03-09 13:18:28,927 - lava_callback - INFO - Starting async job submit for node 69aec88ffeb96b28aa34b6be 2026-03-09 13:18:28,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:28,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88ffeb96b28aa34b6be HTTP/1.1" 200 None 2026-03-09 13:18:28,960 - lava_callback - DEBUG - Processing node 69aec88ffeb96b28aa34b6be: baseline-nfs-arm64 2026-03-09 13:18:28,962 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:18:28,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:29,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:29,090 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88ffeb96b28aa34b6be/lava-logs.yaml 2026-03-09 13:18:29,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:29,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:29,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88ffeb96b28aa34b6be/lava_callback.json.gz 2026-03-09 13:18:29,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:29,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88ffeb96b28aa34b6be HTTP/1.1" 200 None 2026-03-09 13:18:29,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:29,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:29,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:29,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec88ffeb96b28aa34b6be HTTP/1.1" 200 None 2026-03-09 13:18:29,304 - lava_callback - INFO - Completed processing callback for node 69aec88ffeb96b28aa34b6be 2026-03-09 13:18:29,507 - lava_callback - INFO - Received callback for node 69aec876feb96b28aa34b63d INFO: 172.20.0.1:55256 - "POST /node/69aec876feb96b28aa34b63d HTTP/1.0" 202 Accepted 2026-03-09 13:18:29,515 - lava_callback - INFO - Starting async job submit for node 69aec876feb96b28aa34b63d 2026-03-09 13:18:29,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:29,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec876feb96b28aa34b63d HTTP/1.1" 200 None 2026-03-09 13:18:29,577 - lava_callback - DEBUG - Processing node 69aec876feb96b28aa34b63d: baseline-arm64 2026-03-09 13:18:29,709 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:18:29,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:29,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:29,912 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec876feb96b28aa34b63d/lava-logs.yaml 2026-03-09 13:18:29,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:30,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:30,034 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec876feb96b28aa34b63d/lava_callback.json.gz 2026-03-09 13:18:30,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:30,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec876feb96b28aa34b63d HTTP/1.1" 200 None 2026-03-09 13:18:30,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:30,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:30,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:30,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec876feb96b28aa34b63d HTTP/1.1" 200 None 2026-03-09 13:18:30,170 - lava_callback - INFO - Completed processing callback for node 69aec876feb96b28aa34b63d 2026-03-09 13:18:34,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:34,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-09 13:18:35,525 - lava_callback - INFO - Received callback for node 69aec880feb96b28aa34b655 INFO: 172.20.0.1:56102 - "POST /node/69aec880feb96b28aa34b655 HTTP/1.0" 202 Accepted 2026-03-09 13:18:35,531 - lava_callback - INFO - Starting async job submit for node 69aec880feb96b28aa34b655 2026-03-09 13:18:35,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:35,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec880feb96b28aa34b655 HTTP/1.1" 200 None 2026-03-09 13:18:35,550 - lava_callback - DEBUG - Processing node 69aec880feb96b28aa34b655: baseline-arm64 2026-03-09 13:18:35,558 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:18:35,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:35,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:35,740 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec880feb96b28aa34b655/lava-logs.yaml 2026-03-09 13:18:35,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:35,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:35,869 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec880feb96b28aa34b655/lava_callback.json.gz 2026-03-09 13:18:35,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:35,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec880feb96b28aa34b655 HTTP/1.1" 200 None 2026-03-09 13:18:35,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:35,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:35,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:35,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec880feb96b28aa34b655 HTTP/1.1" 200 None 2026-03-09 13:18:35,945 - lava_callback - INFO - Completed processing callback for node 69aec880feb96b28aa34b655 INFO: 172.20.0.1:56106 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:18:39,600 - lava_callback - INFO - Received callback for node 69aec890feb96b28aa34b6c2 INFO: 172.20.0.1:56108 - "POST /node/69aec890feb96b28aa34b6c2 HTTP/1.0" 202 Accepted 2026-03-09 13:18:39,607 - lava_callback - INFO - Starting async job submit for node 69aec890feb96b28aa34b6c2 2026-03-09 13:18:39,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:39,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec890feb96b28aa34b6c2 HTTP/1.1" 200 None 2026-03-09 13:18:39,635 - lava_callback - DEBUG - Processing node 69aec890feb96b28aa34b6c2: baseline-nfs-arm64 2026-03-09 13:18:39,645 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:18:39,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:39,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:39,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec890feb96b28aa34b6c2/lava-logs.yaml 2026-03-09 13:18:39,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:40,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:40,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec890feb96b28aa34b6c2/lava_callback.json.gz 2026-03-09 13:18:40,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:40,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec890feb96b28aa34b6c2 HTTP/1.1" 200 None 2026-03-09 13:18:40,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:40,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:40,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:40,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec890feb96b28aa34b6c2 HTTP/1.1" 200 None 2026-03-09 13:18:40,096 - lava_callback - INFO - Completed processing callback for node 69aec890feb96b28aa34b6c2 2026-03-09 13:18:40,891 - lava_callback - INFO - Received callback for node 69aec87efeb96b28aa34b652 INFO: 172.20.0.1:37898 - "POST /node/69aec87efeb96b28aa34b652 HTTP/1.0" 202 Accepted 2026-03-09 13:18:40,898 - lava_callback - INFO - Starting async job submit for node 69aec87efeb96b28aa34b652 2026-03-09 13:18:40,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:40,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87efeb96b28aa34b652 HTTP/1.1" 200 None 2026-03-09 13:18:40,934 - lava_callback - DEBUG - Processing node 69aec87efeb96b28aa34b652: baseline-arm64 2026-03-09 13:18:41,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:41,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:41,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87efeb96b28aa34b652/log.txt.gz 2026-03-09 13:18:41,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:41,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:41,668 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87efeb96b28aa34b652/lava-logs.yaml 2026-03-09 13:18:41,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:18:41,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:18:41,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87efeb96b28aa34b652/lava_callback.json.gz 2026-03-09 13:18:41,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:41,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87efeb96b28aa34b652 HTTP/1.1" 200 None 2026-03-09 13:18:41,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:41,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:18:41,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:18:41,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec87efeb96b28aa34b652 HTTP/1.1" 200 None 2026-03-09 13:18:41,932 - lava_callback - INFO - Completed processing callback for node 69aec87efeb96b28aa34b652 INFO: 172.20.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:04,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:04,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-09 13:19:06,117 - lava_callback - INFO - Received callback for node 69aec886feb96b28aa34b664 INFO: 172.20.0.1:59918 - "POST /node/69aec886feb96b28aa34b664 HTTP/1.0" 202 Accepted 2026-03-09 13:19:06,124 - lava_callback - INFO - Starting async job submit for node 69aec886feb96b28aa34b664 2026-03-09 13:19:06,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:06,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec886feb96b28aa34b664 HTTP/1.1" 200 None 2026-03-09 13:19:06,156 - lava_callback - DEBUG - Processing node 69aec886feb96b28aa34b664: baseline-arm64 2026-03-09 13:19:06,207 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:19:06,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:06,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:06,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec886feb96b28aa34b664/lava-logs.yaml 2026-03-09 13:19:06,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:06,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:06,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec886feb96b28aa34b664/lava_callback.json.gz INFO: 172.20.0.1:59932 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:06,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:06,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec886feb96b28aa34b664 HTTP/1.1" 200 None 2026-03-09 13:19:06,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:06,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:06,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:06,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec886feb96b28aa34b664 HTTP/1.1" 200 None 2026-03-09 13:19:06,650 - lava_callback - INFO - Completed processing callback for node 69aec886feb96b28aa34b664 2026-03-09 13:19:12,720 - lava_callback - INFO - Received callback for node 69ac25bb40deb775998f55ad INFO: 172.20.0.1:41790 - "POST /node/69ac25bb40deb775998f55ad HTTP/1.0" 202 Accepted 2026-03-09 13:19:12,725 - lava_callback - INFO - Starting async job submit for node 69ac25bb40deb775998f55ad 2026-03-09 13:19:12,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:12,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac25bb40deb775998f55ad HTTP/1.1" 200 None 2026-03-09 13:19:12,741 - lava_callback - DEBUG - Processing node 69ac25bb40deb775998f55ad: baseline-arm64-baylibre 2026-03-09 13:19:12,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac25bb40deb775998f55ad 2026-03-09 13:19:12,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:12,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac25bb40deb775998f55ad HTTP/1.1" 200 None 2026-03-09 13:19:12,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:12,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-09 13:19:12,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:12,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac25bb40deb775998f55ad HTTP/1.1" 200 None 2026-03-09 13:19:12,801 - lava_callback - ERROR - Error processing callback for node 69ac25bb40deb775998f55ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 13:19:13,416 - lava_callback - INFO - Received callback for node 69aec8bffeb96b28aa34b77d INFO: 172.20.0.1:41792 - "POST /node/69aec8bffeb96b28aa34b77d HTTP/1.0" 202 Accepted 2026-03-09 13:19:13,422 - lava_callback - INFO - Starting async job submit for node 69aec8bffeb96b28aa34b77d 2026-03-09 13:19:13,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:13,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bffeb96b28aa34b77d HTTP/1.1" 200 None 2026-03-09 13:19:13,456 - lava_callback - DEBUG - Processing node 69aec8bffeb96b28aa34b77d: baseline-arm64-foundriesio 2026-03-09 13:19:13,508 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:19:13,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:13,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:13,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aec8bffeb96b28aa34b77d/lava-logs.yaml 2026-03-09 13:19:13,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:13,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:13,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aec8bffeb96b28aa34b77d/lava_callback.json.gz 2026-03-09 13:19:13,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:13,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bffeb96b28aa34b77d HTTP/1.1" 200 None 2026-03-09 13:19:13,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:13,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:13,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:13,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8bffeb96b28aa34b77d HTTP/1.1" 200 None 2026-03-09 13:19:13,945 - lava_callback - INFO - Completed processing callback for node 69aec8bffeb96b28aa34b77d INFO: 172.20.0.1:41806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41808 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:19,927 - lava_callback - INFO - Received callback for node 69aec8b1feb96b28aa34b759 INFO: 172.20.0.1:36070 - "POST /node/69aec8b1feb96b28aa34b759 HTTP/1.0" 202 Accepted 2026-03-09 13:19:19,932 - lava_callback - INFO - Starting async job submit for node 69aec8b1feb96b28aa34b759 2026-03-09 13:19:19,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:19,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b1feb96b28aa34b759 HTTP/1.1" 200 None 2026-03-09 13:19:19,956 - lava_callback - DEBUG - Processing node 69aec8b1feb96b28aa34b759: baseline-arm64-broonie 2026-03-09 13:19:19,961 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:19:19,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:20,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:20,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8b1feb96b28aa34b759/lava-logs.yaml 2026-03-09 13:19:20,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:20,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:20,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8b1feb96b28aa34b759/lava_callback.json.gz 2026-03-09 13:19:20,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:20,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b1feb96b28aa34b759 HTTP/1.1" 200 None 2026-03-09 13:19:20,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:20,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:20,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:20,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b1feb96b28aa34b759 HTTP/1.1" 200 None 2026-03-09 13:19:20,291 - lava_callback - INFO - Completed processing callback for node 69aec8b1feb96b28aa34b759 INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:28,018 - lava_callback - INFO - Received callback for node 69aec8a8feb96b28aa34b732 INFO: 172.20.0.1:36090 - "POST /node/69aec8a8feb96b28aa34b732 HTTP/1.0" 202 Accepted 2026-03-09 13:19:28,024 - lava_callback - INFO - Starting async job submit for node 69aec8a8feb96b28aa34b732 2026-03-09 13:19:28,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:28,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a8feb96b28aa34b732 HTTP/1.1" 200 None 2026-03-09 13:19:28,058 - lava_callback - DEBUG - Processing node 69aec8a8feb96b28aa34b732: baseline-arm-pengutronix 2026-03-09 13:19:28,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:28,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:28,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec8a8feb96b28aa34b732/log.txt.gz 2026-03-09 13:19:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:28,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:28,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec8a8feb96b28aa34b732/lava-logs.yaml 2026-03-09 13:19:28,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:28,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:28,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aec8a8feb96b28aa34b732/lava_callback.json.gz 2026-03-09 13:19:28,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:28,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a8feb96b28aa34b732 HTTP/1.1" 200 None 2026-03-09 13:19:28,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:28,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 13:19:28,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:28,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8a8feb96b28aa34b732 HTTP/1.1" 200 None 2026-03-09 13:19:28,820 - lava_callback - INFO - Completed processing callback for node 69aec8a8feb96b28aa34b732 2026-03-09 13:19:30,893 - lava_callback - INFO - Received callback for node 69aec8b7feb96b28aa34b768 INFO: 172.20.0.1:48272 - "POST /node/69aec8b7feb96b28aa34b768 HTTP/1.0" 202 Accepted 2026-03-09 13:19:30,899 - lava_callback - INFO - Starting async job submit for node 69aec8b7feb96b28aa34b768 2026-03-09 13:19:30,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:30,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b7feb96b28aa34b768 HTTP/1.1" 200 None 2026-03-09 13:19:30,918 - lava_callback - DEBUG - Processing node 69aec8b7feb96b28aa34b768: baseline-arm64-clabbe 2026-03-09 13:19:30,923 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:19:30,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:31,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:31,057 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69aec8b7feb96b28aa34b768/lava-logs.yaml 2026-03-09 13:19:31,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:31,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:31,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69aec8b7feb96b28aa34b768/lava_callback.json.gz 2026-03-09 13:19:31,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:31,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b7feb96b28aa34b768 HTTP/1.1" 200 None 2026-03-09 13:19:31,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:31,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:31,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:31,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b7feb96b28aa34b768 HTTP/1.1" 200 None 2026-03-09 13:19:31,247 - lava_callback - INFO - Completed processing callback for node 69aec8b7feb96b28aa34b768 2026-03-09 13:19:31,851 - lava_callback - INFO - Received callback for node 69aec882feb96b28aa34b65b INFO: 172.20.0.1:48286 - "POST /node/69aec882feb96b28aa34b65b HTTP/1.0" 202 Accepted 2026-03-09 13:19:31,857 - lava_callback - INFO - Starting async job submit for node 69aec882feb96b28aa34b65b 2026-03-09 13:19:31,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:31,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec882feb96b28aa34b65b HTTP/1.1" 200 None 2026-03-09 13:19:31,910 - lava_callback - DEBUG - Processing node 69aec882feb96b28aa34b65b: baseline-arm64 2026-03-09 13:19:32,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:32,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:32,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec882feb96b28aa34b65b/log.txt.gz 2026-03-09 13:19:32,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:32,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:32,736 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec882feb96b28aa34b65b/lava-logs.yaml 2026-03-09 13:19:32,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:32,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:32,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec882feb96b28aa34b65b/lava_callback.json.gz DEBUG: Setup failed for 69aec882feb96b28aa34b65b. Transitting job node result: incomplete -> fail 2026-03-09 13:19:32,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:32,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec882feb96b28aa34b65b HTTP/1.1" 200 None 2026-03-09 13:19:32,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:32,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:32,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:33,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec882feb96b28aa34b65b HTTP/1.1" 200 None 2026-03-09 13:19:33,083 - lava_callback - INFO - Completed processing callback for node 69aec882feb96b28aa34b65b 2026-03-09 13:19:34,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:34,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48298 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:41,540 - lava_callback - INFO - Received callback for node 69aec87cfeb96b28aa34b64c INFO: 172.20.0.1:49316 - "POST /node/69aec87cfeb96b28aa34b64c HTTP/1.0" 202 Accepted 2026-03-09 13:19:41,546 - lava_callback - INFO - Starting async job submit for node 69aec87cfeb96b28aa34b64c 2026-03-09 13:19:41,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:41,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87cfeb96b28aa34b64c HTTP/1.1" 200 None 2026-03-09 13:19:41,597 - lava_callback - DEBUG - Processing node 69aec87cfeb96b28aa34b64c: baseline-arm64 2026-03-09 13:19:42,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:42,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:42,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87cfeb96b28aa34b64c/log.txt.gz 2026-03-09 13:19:42,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:42,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:42,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87cfeb96b28aa34b64c/lava-logs.yaml 2026-03-09 13:19:42,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:42,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:42,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87cfeb96b28aa34b64c/lava_callback.json.gz DEBUG: Setup failed for 69aec87cfeb96b28aa34b64c. Transitting job node result: incomplete -> fail 2026-03-09 13:19:42,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:42,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87cfeb96b28aa34b64c HTTP/1.1" 200 None 2026-03-09 13:19:42,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:42,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:42,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:42,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec87cfeb96b28aa34b64c HTTP/1.1" 200 None 2026-03-09 13:19:43,010 - lava_callback - INFO - Completed processing callback for node 69aec87cfeb96b28aa34b64c INFO: 172.20.0.1:49320 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:49,131 - lava_callback - INFO - Received callback for node 69aec8bbfeb96b28aa34b771 INFO: 172.20.0.1:49336 - "POST /node/69aec8bbfeb96b28aa34b771 HTTP/1.0" 202 Accepted 2026-03-09 13:19:49,137 - lava_callback - INFO - Starting async job submit for node 69aec8bbfeb96b28aa34b771 2026-03-09 13:19:49,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:49,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bbfeb96b28aa34b771 HTTP/1.1" 200 None 2026-03-09 13:19:49,174 - lava_callback - DEBUG - Processing node 69aec8bbfeb96b28aa34b771: baseline-arm64-pengutronix 2026-03-09 13:19:49,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:49,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:49,565 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bbfeb96b28aa34b771/log.txt.gz 2026-03-09 13:19:49,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:49,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:49,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bbfeb96b28aa34b771/lava-logs.yaml 2026-03-09 13:19:49,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:50,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:50,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bbfeb96b28aa34b771/lava_callback.json.gz 2026-03-09 13:19:50,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:50,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bbfeb96b28aa34b771 HTTP/1.1" 200 None 2026-03-09 13:19:50,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:50,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:50,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:50,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8bbfeb96b28aa34b771 HTTP/1.1" 200 None 2026-03-09 13:19:50,165 - lava_callback - INFO - Completed processing callback for node 69aec8bbfeb96b28aa34b771 INFO: 172.20.0.1:38718 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:54,420 - lava_callback - INFO - Received callback for node 69aec87bfeb96b28aa34b649 INFO: 172.20.0.1:38720 - "POST /node/69aec87bfeb96b28aa34b649 HTTP/1.0" 202 Accepted 2026-03-09 13:19:54,427 - lava_callback - INFO - Starting async job submit for node 69aec87bfeb96b28aa34b649 2026-03-09 13:19:54,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:54,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87bfeb96b28aa34b649 HTTP/1.1" 200 None 2026-03-09 13:19:54,474 - lava_callback - DEBUG - Processing node 69aec87bfeb96b28aa34b649: baseline-arm64 2026-03-09 13:19:55,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:55,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:55,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87bfeb96b28aa34b649/log.txt.gz 2026-03-09 13:19:55,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:56,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:56,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87bfeb96b28aa34b649/lava-logs.yaml 2026-03-09 13:19:56,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:56,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:56,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87bfeb96b28aa34b649/lava_callback.json.gz DEBUG: Setup failed for 69aec87bfeb96b28aa34b649. Transitting job node result: incomplete -> fail 2026-03-09 13:19:56,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:56,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87bfeb96b28aa34b649 HTTP/1.1" 200 None 2026-03-09 13:19:56,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:56,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:56,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:56,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec87bfeb96b28aa34b649 HTTP/1.1" 200 None INFO: 172.20.0.1:38728 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:19:56,567 - lava_callback - INFO - Completed processing callback for node 69aec87bfeb96b28aa34b649 2026-03-09 13:19:57,389 - lava_callback - INFO - Received callback for node 69aec88dfeb96b28aa34b6b2 INFO: 172.20.0.1:38738 - "POST /node/69aec88dfeb96b28aa34b6b2 HTTP/1.0" 202 Accepted 2026-03-09 13:19:57,396 - lava_callback - INFO - Starting async job submit for node 69aec88dfeb96b28aa34b6b2 2026-03-09 13:19:57,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:57,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88dfeb96b28aa34b6b2 HTTP/1.1" 200 None 2026-03-09 13:19:57,445 - lava_callback - DEBUG - Processing node 69aec88dfeb96b28aa34b6b2: baseline-nfs-arm64 2026-03-09 13:19:57,573 - lava_callback - INFO - Received callback for node 69aec8bcfeb96b28aa34b774 INFO: 172.20.0.1:38740 - "POST /node/69aec8bcfeb96b28aa34b774 HTTP/1.0" 202 Accepted 2026-03-09 13:19:57,604 - lava_callback - INFO - Starting async job submit for node 69aec8bcfeb96b28aa34b774 2026-03-09 13:19:57,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:57,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bcfeb96b28aa34b774 HTTP/1.1" 200 None 2026-03-09 13:19:57,784 - lava_callback - DEBUG - Processing node 69aec8bcfeb96b28aa34b774: baseline-arm64-pengutronix 2026-03-09 13:19:58,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:58,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:58,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:58,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bcfeb96b28aa34b774/log.txt.gz 2026-03-09 13:19:58,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:58,344 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88dfeb96b28aa34b6b2/log.txt.gz 2026-03-09 13:19:58,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:58,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:58,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:58,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bcfeb96b28aa34b774/lava-logs.yaml 2026-03-09 13:19:58,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:58,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:58,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bcfeb96b28aa34b774/lava_callback.json.gz 2026-03-09 13:19:58,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:58,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:58,819 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88dfeb96b28aa34b6b2/lava-logs.yaml 2026-03-09 13:19:58,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bcfeb96b28aa34b774 HTTP/1.1" 200 None 2026-03-09 13:19:58,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:58,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:19:58,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:58,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:58,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8bcfeb96b28aa34b774 HTTP/1.1" 200 None 2026-03-09 13:19:58,875 - lava_callback - INFO - Completed processing callback for node 69aec8bcfeb96b28aa34b774 2026-03-09 13:19:59,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:19:59,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88dfeb96b28aa34b6b2/lava_callback.json.gz DEBUG: Setup failed for 69aec88dfeb96b28aa34b6b2. Transitting job node result: incomplete -> fail 2026-03-09 13:19:59,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:59,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88dfeb96b28aa34b6b2 HTTP/1.1" 200 None 2026-03-09 13:19:59,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:59,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:19:59,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:19:59,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec88dfeb96b28aa34b6b2 HTTP/1.1" 200 None 2026-03-09 13:19:59,264 - lava_callback - INFO - Completed processing callback for node 69aec88dfeb96b28aa34b6b2 2026-03-09 13:20:02,473 - lava_callback - INFO - Received callback for node 69aec8bdfeb96b28aa34b777 INFO: 172.20.0.1:57940 - "POST /node/69aec8bdfeb96b28aa34b777 HTTP/1.0" 202 Accepted 2026-03-09 13:20:02,483 - lava_callback - INFO - Starting async job submit for node 69aec8bdfeb96b28aa34b777 2026-03-09 13:20:02,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:02,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bdfeb96b28aa34b777 HTTP/1.1" 200 None 2026-03-09 13:20:02,518 - lava_callback - DEBUG - Processing node 69aec8bdfeb96b28aa34b777: baseline-arm64-pengutronix 2026-03-09 13:20:02,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:02,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:02,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bdfeb96b28aa34b777/log.txt.gz 2026-03-09 13:20:02,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:03,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:03,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bdfeb96b28aa34b777/lava-logs.yaml 2026-03-09 13:20:03,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:03,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:03,292 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69aec8bdfeb96b28aa34b777/lava_callback.json.gz 2026-03-09 13:20:03,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:03,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8bdfeb96b28aa34b777 HTTP/1.1" 200 None 2026-03-09 13:20:03,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:03,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:03,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:03,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8bdfeb96b28aa34b777 HTTP/1.1" 200 None 2026-03-09 13:20:03,378 - lava_callback - INFO - Completed processing callback for node 69aec8bdfeb96b28aa34b777 2026-03-09 13:20:03,841 - lava_callback - INFO - Received callback for node 69aec88bfeb96b28aa34b6aa INFO: 172.20.0.1:57944 - "POST /node/69aec88bfeb96b28aa34b6aa HTTP/1.0" 202 Accepted 2026-03-09 13:20:03,848 - lava_callback - INFO - Starting async job submit for node 69aec88bfeb96b28aa34b6aa 2026-03-09 13:20:03,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:03,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88bfeb96b28aa34b6aa HTTP/1.1" 200 None 2026-03-09 13:20:03,899 - lava_callback - DEBUG - Processing node 69aec88bfeb96b28aa34b6aa: baseline-nfs-arm64 2026-03-09 13:20:04,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:04,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-09 13:20:04,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:04,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:04,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88bfeb96b28aa34b6aa/log.txt.gz 2026-03-09 13:20:05,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:05,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:05,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88bfeb96b28aa34b6aa/lava-logs.yaml 2026-03-09 13:20:05,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:05,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:05,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88bfeb96b28aa34b6aa/lava_callback.json.gz DEBUG: Setup failed for 69aec88bfeb96b28aa34b6aa. Transitting job node result: incomplete -> fail 2026-03-09 13:20:05,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:05,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88bfeb96b28aa34b6aa HTTP/1.1" 200 None 2026-03-09 13:20:05,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:05,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:05,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:05,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec88bfeb96b28aa34b6aa HTTP/1.1" 200 None 2026-03-09 13:20:05,904 - lava_callback - INFO - Completed processing callback for node 69aec88bfeb96b28aa34b6aa 2026-03-09 13:20:06,205 - lava_callback - INFO - Received callback for node 69aec87dfeb96b28aa34b64f INFO: 172.20.0.1:57952 - "POST /node/69aec87dfeb96b28aa34b64f HTTP/1.0" 202 Accepted 2026-03-09 13:20:06,212 - lava_callback - INFO - Starting async job submit for node 69aec87dfeb96b28aa34b64f 2026-03-09 13:20:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:06,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87dfeb96b28aa34b64f HTTP/1.1" 200 None 2026-03-09 13:20:06,264 - lava_callback - DEBUG - Processing node 69aec87dfeb96b28aa34b64f: baseline-arm64 INFO: 172.20.0.1:57956 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:20:06,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:06,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:06,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87dfeb96b28aa34b64f/log.txt.gz 2026-03-09 13:20:07,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:07,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:07,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87dfeb96b28aa34b64f/lava-logs.yaml 2026-03-09 13:20:07,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:07,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:07,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87dfeb96b28aa34b64f/lava_callback.json.gz DEBUG: Setup failed for 69aec87dfeb96b28aa34b64f. Transitting job node result: incomplete -> fail 2026-03-09 13:20:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:07,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87dfeb96b28aa34b64f HTTP/1.1" 200 None 2026-03-09 13:20:07,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:07,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:07,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:07,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec87dfeb96b28aa34b64f HTTP/1.1" 200 None 2026-03-09 13:20:07,796 - lava_callback - INFO - Completed processing callback for node 69aec87dfeb96b28aa34b64f 2026-03-09 13:20:09,651 - lava_callback - INFO - Received callback for node 69aec894feb96b28aa34b6cf INFO: 172.20.0.1:57972 - "POST /node/69aec894feb96b28aa34b6cf HTTP/1.0" 202 Accepted 2026-03-09 13:20:09,658 - lava_callback - INFO - Starting async job submit for node 69aec894feb96b28aa34b6cf 2026-03-09 13:20:09,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:09,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec894feb96b28aa34b6cf HTTP/1.1" 200 None 2026-03-09 13:20:09,704 - lava_callback - DEBUG - Processing node 69aec894feb96b28aa34b6cf: baseline-nfs-arm64 2026-03-09 13:20:10,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:10,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:10,233 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec894feb96b28aa34b6cf/log.txt.gz 2026-03-09 13:20:10,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:10,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:10,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec894feb96b28aa34b6cf/lava-logs.yaml 2026-03-09 13:20:10,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:10,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:10,801 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec894feb96b28aa34b6cf/lava_callback.json.gz DEBUG: Setup failed for 69aec894feb96b28aa34b6cf. Transitting job node result: incomplete -> fail 2026-03-09 13:20:10,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:10,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec894feb96b28aa34b6cf HTTP/1.1" 200 None 2026-03-09 13:20:10,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:10,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:10,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:10,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec894feb96b28aa34b6cf HTTP/1.1" 200 None 2026-03-09 13:20:11,011 - lava_callback - INFO - Completed processing callback for node 69aec894feb96b28aa34b6cf INFO: 172.20.0.1:46244 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 13:20:16,409 - lava_callback - INFO - Received callback for node 69aec893feb96b28aa34b6cc INFO: 172.20.0.1:46252 - "POST /node/69aec893feb96b28aa34b6cc HTTP/1.0" 202 Accepted 2026-03-09 13:20:16,416 - lava_callback - INFO - Starting async job submit for node 69aec893feb96b28aa34b6cc 2026-03-09 13:20:16,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:16,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec893feb96b28aa34b6cc HTTP/1.1" 200 None 2026-03-09 13:20:16,462 - lava_callback - DEBUG - Processing node 69aec893feb96b28aa34b6cc: baseline-nfs-arm64 INFO: 172.20.0.1:46262 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:20:16,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:16,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:16,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec893feb96b28aa34b6cc/log.txt.gz 2026-03-09 13:20:17,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:17,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:17,291 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec893feb96b28aa34b6cc/lava-logs.yaml 2026-03-09 13:20:17,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:17,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:17,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec893feb96b28aa34b6cc/lava_callback.json.gz DEBUG: Setup failed for 69aec893feb96b28aa34b6cc. Transitting job node result: incomplete -> fail 2026-03-09 13:20:17,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:17,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec893feb96b28aa34b6cc HTTP/1.1" 200 None 2026-03-09 13:20:17,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:17,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:17,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:17,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec893feb96b28aa34b6cc HTTP/1.1" 200 None 2026-03-09 13:20:17,623 - lava_callback - INFO - Completed processing callback for node 69aec893feb96b28aa34b6cc 2026-03-09 13:20:18,925 - lava_callback - INFO - Received callback for node 69aec885feb96b28aa34b661 INFO: 172.20.0.1:46276 - "POST /node/69aec885feb96b28aa34b661 HTTP/1.0" 202 Accepted 2026-03-09 13:20:18,931 - lava_callback - INFO - Starting async job submit for node 69aec885feb96b28aa34b661 2026-03-09 13:20:18,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:18,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec885feb96b28aa34b661 HTTP/1.1" 200 None 2026-03-09 13:20:18,978 - lava_callback - DEBUG - Processing node 69aec885feb96b28aa34b661: baseline-arm64 2026-03-09 13:20:19,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:19,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:19,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec885feb96b28aa34b661/log.txt.gz 2026-03-09 13:20:19,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:19,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:19,830 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec885feb96b28aa34b661/lava-logs.yaml 2026-03-09 13:20:19,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:19,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:19,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec885feb96b28aa34b661/lava_callback.json.gz DEBUG: Setup failed for 69aec885feb96b28aa34b661. Transitting job node result: incomplete -> fail 2026-03-09 13:20:20,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:20,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec885feb96b28aa34b661 HTTP/1.1" 200 None 2026-03-09 13:20:20,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:20,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:20,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:20,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec885feb96b28aa34b661 HTTP/1.1" 200 None 2026-03-09 13:20:20,146 - lava_callback - INFO - Completed processing callback for node 69aec885feb96b28aa34b661 2026-03-09 13:20:20,472 - lava_callback - INFO - Received callback for node 69aec883feb96b28aa34b65e INFO: 172.20.0.1:42296 - "POST /node/69aec883feb96b28aa34b65e HTTP/1.0" 202 Accepted 2026-03-09 13:20:20,479 - lava_callback - INFO - Starting async job submit for node 69aec883feb96b28aa34b65e 2026-03-09 13:20:20,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:20,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec883feb96b28aa34b65e HTTP/1.1" 200 None 2026-03-09 13:20:20,544 - lava_callback - DEBUG - Processing node 69aec883feb96b28aa34b65e: baseline-arm64 2026-03-09 13:20:20,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:21,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:21,049 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec883feb96b28aa34b65e/log.txt.gz 2026-03-09 13:20:21,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:21,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:21,545 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec883feb96b28aa34b65e/lava-logs.yaml 2026-03-09 13:20:21,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:21,591 - lava_callback - INFO - Received callback for node 69aec88efeb96b28aa34b6b9 INFO: 172.20.0.1:42312 - "POST /node/69aec88efeb96b28aa34b6b9 HTTP/1.0" 202 Accepted 2026-03-09 13:20:21,598 - lava_callback - INFO - Starting async job submit for node 69aec88efeb96b28aa34b6b9 2026-03-09 13:20:21,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:21,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88efeb96b28aa34b6b9 HTTP/1.1" 200 None 2026-03-09 13:20:21,657 - lava_callback - DEBUG - Processing node 69aec88efeb96b28aa34b6b9: baseline-nfs-arm64 2026-03-09 13:20:21,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:21,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec883feb96b28aa34b65e/lava_callback.json.gz DEBUG: Setup failed for 69aec883feb96b28aa34b65e. Transitting job node result: incomplete -> fail 2026-03-09 13:20:21,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:21,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec883feb96b28aa34b65e HTTP/1.1" 200 None 2026-03-09 13:20:21,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:22,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:22,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:22,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec883feb96b28aa34b65e HTTP/1.1" 200 None 2026-03-09 13:20:22,344 - lava_callback - INFO - Completed processing callback for node 69aec883feb96b28aa34b65e 2026-03-09 13:20:22,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:22,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:22,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88efeb96b28aa34b6b9/log.txt.gz 2026-03-09 13:20:22,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:23,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:23,045 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88efeb96b28aa34b6b9/lava-logs.yaml 2026-03-09 13:20:23,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:23,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:23,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88efeb96b28aa34b6b9/lava_callback.json.gz DEBUG: Setup failed for 69aec88efeb96b28aa34b6b9. Transitting job node result: incomplete -> fail 2026-03-09 13:20:23,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:23,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88efeb96b28aa34b6b9 HTTP/1.1" 200 None 2026-03-09 13:20:23,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:23,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:23,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:23,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec88efeb96b28aa34b6b9 HTTP/1.1" 200 None 2026-03-09 13:20:23,422 - lava_callback - INFO - Completed processing callback for node 69aec88efeb96b28aa34b6b9 INFO: 172.20.0.1:42320 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:20:28,358 - lava_callback - INFO - Received callback for node 69ac260c40deb775998f55d1 INFO: 172.20.0.1:42332 - "POST /node/69ac260c40deb775998f55d1 HTTP/1.0" 202 Accepted 2026-03-09 13:20:28,364 - lava_callback - INFO - Starting async job submit for node 69ac260c40deb775998f55d1 2026-03-09 13:20:28,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:28,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac260c40deb775998f55d1 HTTP/1.1" 200 None 2026-03-09 13:20:28,380 - lava_callback - DEBUG - Processing node 69ac260c40deb775998f55d1: baseline-arm64-clabbe 2026-03-09 13:20:28,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac260c40deb775998f55d1 2026-03-09 13:20:28,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:28,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac260c40deb775998f55d1 HTTP/1.1" 200 None 2026-03-09 13:20:28,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:28,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-09 13:20:28,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:28,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac260c40deb775998f55d1 HTTP/1.1" 200 None 2026-03-09 13:20:28,434 - lava_callback - ERROR - Error processing callback for node 69ac260c40deb775998f55d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 13:20:30,059 - lava_callback - INFO - Received callback for node 69aec8befeb96b28aa34b77a INFO: 172.20.0.1:53376 - "POST /node/69aec8befeb96b28aa34b77a HTTP/1.0" 202 Accepted 2026-03-09 13:20:30,065 - lava_callback - INFO - Starting async job submit for node 69aec8befeb96b28aa34b77a 2026-03-09 13:20:30,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:30,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8befeb96b28aa34b77a HTTP/1.1" 200 None 2026-03-09 13:20:30,112 - lava_callback - DEBUG - Processing node 69aec8befeb96b28aa34b77a: baseline-arm64-foundriesio 2026-03-09 13:20:30,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:30,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:30,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aec8befeb96b28aa34b77a/log.txt.gz 2026-03-09 13:20:30,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:30,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:30,806 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aec8befeb96b28aa34b77a/lava-logs.yaml 2026-03-09 13:20:30,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:30,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:30,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aec8befeb96b28aa34b77a/lava_callback.json.gz DEBUG: Setup failed for 69aec8befeb96b28aa34b77a. Transitting job node result: incomplete -> fail 2026-03-09 13:20:31,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:31,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8befeb96b28aa34b77a HTTP/1.1" 200 None 2026-03-09 13:20:31,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:31,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:31,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:31,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8befeb96b28aa34b77a HTTP/1.1" 200 None 2026-03-09 13:20:31,136 - lava_callback - INFO - Completed processing callback for node 69aec8befeb96b28aa34b77a 2026-03-09 13:20:34,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:34,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:53384 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:20:38,917 - lava_callback - INFO - Received callback for node 69aec896feb96b28aa34b6d2 INFO: 172.20.0.1:53388 - "POST /node/69aec896feb96b28aa34b6d2 HTTP/1.0" 202 Accepted 2026-03-09 13:20:38,924 - lava_callback - INFO - Starting async job submit for node 69aec896feb96b28aa34b6d2 2026-03-09 13:20:38,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:38,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec896feb96b28aa34b6d2 HTTP/1.1" 200 None 2026-03-09 13:20:38,970 - lava_callback - DEBUG - Processing node 69aec896feb96b28aa34b6d2: baseline-nfs-arm64 2026-03-09 13:20:39,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:39,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:39,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec896feb96b28aa34b6d2/log.txt.gz 2026-03-09 13:20:39,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:39,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:39,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec896feb96b28aa34b6d2/lava-logs.yaml 2026-03-09 13:20:39,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:20:39,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:20:39,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec896feb96b28aa34b6d2/lava_callback.json.gz DEBUG: Setup failed for 69aec896feb96b28aa34b6d2. Transitting job node result: incomplete -> fail 2026-03-09 13:20:40,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:40,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec896feb96b28aa34b6d2 HTTP/1.1" 200 None 2026-03-09 13:20:40,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:40,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:20:40,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:20:40,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec896feb96b28aa34b6d2 HTTP/1.1" 200 None 2026-03-09 13:20:40,228 - lava_callback - INFO - Completed processing callback for node 69aec896feb96b28aa34b6d2 INFO: 172.20.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50938 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:21:04,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:04,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-09 13:21:05,641 - lava_callback - INFO - Received callback for node 69aec875feb96b28aa34b63a INFO: 172.20.0.1:50228 - "POST /node/69aec875feb96b28aa34b63a HTTP/1.0" 202 Accepted 2026-03-09 13:21:05,647 - lava_callback - INFO - Starting async job submit for node 69aec875feb96b28aa34b63a 2026-03-09 13:21:05,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:05,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec875feb96b28aa34b63a HTTP/1.1" 200 None 2026-03-09 13:21:05,694 - lava_callback - DEBUG - Processing node 69aec875feb96b28aa34b63a: baseline-arm64 2026-03-09 13:21:06,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:21:06,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:06,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec875feb96b28aa34b63a/log.txt.gz 2026-03-09 13:21:06,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:50232 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:21:06,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:06,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec875feb96b28aa34b63a/lava-logs.yaml 2026-03-09 13:21:06,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:21:06,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:06,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec875feb96b28aa34b63a/lava_callback.json.gz DEBUG: Setup failed for 69aec875feb96b28aa34b63a. Transitting job node result: incomplete -> fail 2026-03-09 13:21:06,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:06,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec875feb96b28aa34b63a HTTP/1.1" 200 None 2026-03-09 13:21:06,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:06,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:21:06,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:06,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec875feb96b28aa34b63a HTTP/1.1" 200 None 2026-03-09 13:21:07,063 - lava_callback - INFO - Completed processing callback for node 69aec875feb96b28aa34b63a INFO: 172.20.0.1:37250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:21:32,846 - lava_callback - INFO - Received callback for node 69ac265240deb775998f55dc INFO: 172.20.0.1:56996 - "POST /node/69ac265240deb775998f55dc HTTP/1.0" 202 Accepted 2026-03-09 13:21:32,852 - lava_callback - INFO - Starting async job submit for node 69ac265240deb775998f55dc 2026-03-09 13:21:32,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:32,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac265240deb775998f55dc HTTP/1.1" 200 None 2026-03-09 13:21:32,895 - lava_callback - DEBUG - Processing node 69ac265240deb775998f55dc: baseline-arm64-baylibre 2026-03-09 13:21:32,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac265240deb775998f55dc 2026-03-09 13:21:32,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:32,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac265240deb775998f55dc HTTP/1.1" 200 None 2026-03-09 13:21:32,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:32,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-09 13:21:32,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:32,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac265240deb775998f55dc HTTP/1.1" 200 None 2026-03-09 13:21:32,957 - lava_callback - ERROR - Error processing callback for node 69ac265240deb775998f55dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 13:21:34,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:34,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-09 13:21:35,368 - lava_callback - INFO - Received callback for node 69aec887feb96b28aa34b667 INFO: 172.20.0.1:57000 - "POST /node/69aec887feb96b28aa34b667 HTTP/1.0" 202 Accepted 2026-03-09 13:21:35,375 - lava_callback - INFO - Starting async job submit for node 69aec887feb96b28aa34b667 2026-03-09 13:21:35,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:35,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec887feb96b28aa34b667 HTTP/1.1" 200 None 2026-03-09 13:21:35,423 - lava_callback - DEBUG - Processing node 69aec887feb96b28aa34b667: baseline-nfs-arm64 2026-03-09 13:21:35,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:21:35,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:35,986 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec887feb96b28aa34b667/log.txt.gz 2026-03-09 13:21:36,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:21:36,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:36,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec887feb96b28aa34b667/lava-logs.yaml 2026-03-09 13:21:36,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57004 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:21:36,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:36,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec887feb96b28aa34b667/lava_callback.json.gz DEBUG: Setup failed for 69aec887feb96b28aa34b667. Transitting job node result: incomplete -> fail 2026-03-09 13:21:36,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:36,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec887feb96b28aa34b667 HTTP/1.1" 200 None 2026-03-09 13:21:36,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:36,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:21:36,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:36,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec887feb96b28aa34b667 HTTP/1.1" 200 None 2026-03-09 13:21:36,804 - lava_callback - INFO - Completed processing callback for node 69aec887feb96b28aa34b667 INFO: 172.20.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56998 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:21:54,111 - lava_callback - INFO - Received callback for node 69aec376feb96b28aa34b025 INFO: 172.20.0.1:57008 - "POST /node/69aec376feb96b28aa34b025 HTTP/1.0" 202 Accepted 2026-03-09 13:21:54,117 - lava_callback - INFO - Starting async job submit for node 69aec376feb96b28aa34b025 2026-03-09 13:21:54,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:54,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec376feb96b28aa34b025 HTTP/1.1" 200 None 2026-03-09 13:21:54,194 - lava_callback - DEBUG - Processing node 69aec376feb96b28aa34b025: ltp-smoke 2026-03-09 13:21:54,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:21:54,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:54,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69aec376feb96b28aa34b025/log.txt.gz 2026-03-09 13:21:55,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:21:55,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:55,319 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69aec376feb96b28aa34b025/lava-logs.yaml 2026-03-09 13:21:55,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:21:55,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:21:55,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69aec376feb96b28aa34b025/lava_callback.json.gz 2026-03-09 13:21:55,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:55,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec376feb96b28aa34b025 HTTP/1.1" 200 None 2026-03-09 13:21:55,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba38feb96b28aa34a77b HTTP/1.1" 200 None 2026-03-09 13:21:55,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:55,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec376feb96b28aa34b025 HTTP/1.1" 200 None 2026-03-09 13:21:55,816 - lava_callback - INFO - Completed processing callback for node 69aec376feb96b28aa34b025 INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:21:59,555 - lava_callback - INFO - Received callback for node 69aec878feb96b28aa34b643 INFO: 172.20.0.1:57026 - "POST /node/69aec878feb96b28aa34b643 HTTP/1.0" 202 Accepted 2026-03-09 13:21:59,561 - lava_callback - INFO - Starting async job submit for node 69aec878feb96b28aa34b643 2026-03-09 13:21:59,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:21:59,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec878feb96b28aa34b643 HTTP/1.1" 200 None 2026-03-09 13:21:59,601 - lava_callback - DEBUG - Processing node 69aec878feb96b28aa34b643: baseline-arm64 2026-03-09 13:21:59,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:22:00,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:22:00,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec878feb96b28aa34b643/log.txt.gz 2026-03-09 13:22:00,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:22:00,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:22:00,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec878feb96b28aa34b643/lava-logs.yaml 2026-03-09 13:22:00,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:22:00,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:22:00,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec878feb96b28aa34b643/lava_callback.json.gz 2026-03-09 13:22:00,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:00,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec878feb96b28aa34b643 HTTP/1.1" 200 None 2026-03-09 13:22:00,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:00,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:22:00,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:00,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec878feb96b28aa34b643 HTTP/1.1" 200 None 2026-03-09 13:22:00,776 - lava_callback - INFO - Completed processing callback for node 69aec878feb96b28aa34b643 2026-03-09 13:22:04,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:04,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:22:19,114 - lava_callback - INFO - Received callback for node 69aec889feb96b28aa34b66a INFO: 172.20.0.1:44014 - "POST /node/69aec889feb96b28aa34b66a HTTP/1.0" 202 Accepted 2026-03-09 13:22:19,120 - lava_callback - INFO - Starting async job submit for node 69aec889feb96b28aa34b66a 2026-03-09 13:22:19,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:19,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec889feb96b28aa34b66a HTTP/1.1" 200 None 2026-03-09 13:22:19,174 - lava_callback - DEBUG - Processing node 69aec889feb96b28aa34b66a: baseline-nfs-arm64 2026-03-09 13:22:19,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:22:19,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:22:19,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec889feb96b28aa34b66a/log.txt.gz 2026-03-09 13:22:19,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:22:20,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:22:20,159 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec889feb96b28aa34b66a/lava-logs.yaml 2026-03-09 13:22:20,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:22:20,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:22:20,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec889feb96b28aa34b66a/lava_callback.json.gz 2026-03-09 13:22:20,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:20,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec889feb96b28aa34b66a HTTP/1.1" 200 None 2026-03-09 13:22:20,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:20,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:22:20,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:20,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec889feb96b28aa34b66a HTTP/1.1" 200 None 2026-03-09 13:22:20,433 - lava_callback - INFO - Completed processing callback for node 69aec889feb96b28aa34b66a INFO: 172.20.0.1:55412 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:22:34,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:34,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:22:52,919 - lava_callback - INFO - Received callback for node 69ac269d40deb775998f55f5 INFO: 172.20.0.1:38498 - "POST /node/69ac269d40deb775998f55f5 HTTP/1.0" 202 Accepted 2026-03-09 13:22:52,925 - lava_callback - INFO - Starting async job submit for node 69ac269d40deb775998f55f5 2026-03-09 13:22:52,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:52,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac269d40deb775998f55f5 HTTP/1.1" 200 None 2026-03-09 13:22:52,942 - lava_callback - DEBUG - Processing node 69ac269d40deb775998f55f5: baseline-arm64-baylibre 2026-03-09 13:22:52,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac269d40deb775998f55f5 2026-03-09 13:22:52,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:52,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac269d40deb775998f55f5 HTTP/1.1" 200 None 2026-03-09 13:22:52,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:38504 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:22:52,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-09 13:22:52,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:22:53,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac269d40deb775998f55f5 HTTP/1.1" 200 None 2026-03-09 13:22:53,009 - lava_callback - ERROR - Error processing callback for node 69ac269d40deb775998f55f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39104 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:23:48,512 - lava_callback - INFO - Received callback for node 69ac26df40deb775998f560d INFO: 172.20.0.1:39114 - "POST /node/69ac26df40deb775998f560d HTTP/1.0" 202 Accepted 2026-03-09 13:23:48,520 - lava_callback - INFO - Starting async job submit for node 69ac26df40deb775998f560d 2026-03-09 13:23:48,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:23:48,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac26df40deb775998f560d HTTP/1.1" 200 None 2026-03-09 13:23:48,562 - lava_callback - DEBUG - Processing node 69ac26df40deb775998f560d: baseline-arm-clabbe 2026-03-09 13:23:48,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac26df40deb775998f560d 2026-03-09 13:23:48,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:23:48,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac26df40deb775998f560d HTTP/1.1" 200 None 2026-03-09 13:23:48,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:23:48,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-09 13:23:48,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:23:48,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac26df40deb775998f560d HTTP/1.1" 200 None 2026-03-09 13:23:48,663 - lava_callback - ERROR - Error processing callback for node 69ac26df40deb775998f560d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41646 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:24:47,095 - lava_callback - INFO - Received callback for node 69aeca05feb96b28aa34b9cb INFO: 172.20.0.1:41652 - "POST /node/69aeca05feb96b28aa34b9cb HTTP/1.0" 202 Accepted 2026-03-09 13:24:47,101 - lava_callback - INFO - Starting async job submit for node 69aeca05feb96b28aa34b9cb 2026-03-09 13:24:47,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:47,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca05feb96b28aa34b9cb HTTP/1.1" 200 None 2026-03-09 13:24:47,125 - lava_callback - DEBUG - Processing node 69aeca05feb96b28aa34b9cb: baseline-arm 2026-03-09 13:24:47,130 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:24:47,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:24:47,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:24:47,269 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aeca05feb96b28aa34b9cb/lava-logs.yaml 2026-03-09 13:24:47,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:24:47,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:24:47,618 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aeca05feb96b28aa34b9cb/lava_callback.json.gz 2026-03-09 13:24:47,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:47,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca05feb96b28aa34b9cb HTTP/1.1" 200 None 2026-03-09 13:24:47,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:47,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 13:24:47,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:47,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeca05feb96b28aa34b9cb HTTP/1.1" 200 None 2026-03-09 13:24:47,735 - lava_callback - INFO - Completed processing callback for node 69aeca05feb96b28aa34b9cb 2026-03-09 13:24:48,574 - lava_callback - INFO - Received callback for node 69ac271140deb775998f5620 INFO: 172.20.0.1:41668 - "POST /node/69ac271140deb775998f5620 HTTP/1.0" 202 Accepted 2026-03-09 13:24:48,580 - lava_callback - INFO - Starting async job submit for node 69ac271140deb775998f5620 2026-03-09 13:24:48,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:48,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac271140deb775998f5620 HTTP/1.1" 200 None 2026-03-09 13:24:48,605 - lava_callback - DEBUG - Processing node 69ac271140deb775998f5620: baseline-arm64-clabbe 2026-03-09 13:24:48,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac271140deb775998f5620 2026-03-09 13:24:48,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:48,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac271140deb775998f5620 HTTP/1.1" 200 None 2026-03-09 13:24:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:48,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-09 13:24:48,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:24:48,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac271140deb775998f5620 HTTP/1.1" 200 None 2026-03-09 13:24:48,689 - lava_callback - ERROR - Error processing callback for node 69ac271140deb775998f5620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:25:04,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:25:04,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49740 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:28:32,464 - lava_callback - INFO - Received callback for node 69aec881feb96b28aa34b658 INFO: 172.20.0.1:40428 - "POST /node/69aec881feb96b28aa34b658 HTTP/1.0" 202 Accepted 2026-03-09 13:28:32,470 - lava_callback - INFO - Starting async job submit for node 69aec881feb96b28aa34b658 2026-03-09 13:28:32,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:28:32,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec881feb96b28aa34b658 HTTP/1.1" 200 None 2026-03-09 13:28:32,510 - lava_callback - DEBUG - Processing node 69aec881feb96b28aa34b658: baseline-arm64 2026-03-09 13:28:33,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:28:33,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:28:33,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec881feb96b28aa34b658/log.txt.gz 2026-03-09 13:28:33,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:28:33,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:28:33,607 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec881feb96b28aa34b658/lava-logs.yaml 2026-03-09 13:28:33,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:28:33,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:28:33,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec881feb96b28aa34b658/lava_callback.json.gz 2026-03-09 13:28:33,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:28:33,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec881feb96b28aa34b658 HTTP/1.1" 200 None 2026-03-09 13:28:33,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:28:33,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:28:33,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:28:33,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec881feb96b28aa34b658 HTTP/1.1" 200 None 2026-03-09 13:28:33,903 - lava_callback - INFO - Completed processing callback for node 69aec881feb96b28aa34b658 2026-03-09 13:28:34,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:28:34,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51000 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:29:07,198 - lava_callback - INFO - Received callback for node 69aec87afeb96b28aa34b646 INFO: 172.20.0.1:51012 - "POST /node/69aec87afeb96b28aa34b646 HTTP/1.0" 202 Accepted 2026-03-09 13:29:07,204 - lava_callback - INFO - Starting async job submit for node 69aec87afeb96b28aa34b646 2026-03-09 13:29:07,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:07,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87afeb96b28aa34b646 HTTP/1.1" 200 None 2026-03-09 13:29:07,249 - lava_callback - DEBUG - Processing node 69aec87afeb96b28aa34b646: baseline-arm64 2026-03-09 13:29:07,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:07,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:07,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87afeb96b28aa34b646/log.txt.gz 2026-03-09 13:29:07,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:08,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:08,078 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87afeb96b28aa34b646/lava-logs.yaml 2026-03-09 13:29:08,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:08,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:08,213 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aec87afeb96b28aa34b646/lava_callback.json.gz 2026-03-09 13:29:08,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:08,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec87afeb96b28aa34b646 HTTP/1.1" 200 None 2026-03-09 13:29:08,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:08,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:29:08,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:08,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec87afeb96b28aa34b646 HTTP/1.1" 200 None 2026-03-09 13:29:08,386 - lava_callback - INFO - Completed processing callback for node 69aec87afeb96b28aa34b646 INFO: 172.20.0.1:37526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:29:19,712 - lava_callback - INFO - Received callback for node 69aec891feb96b28aa34b6c9 INFO: 172.20.0.1:47314 - "POST /node/69aec891feb96b28aa34b6c9 HTTP/1.0" 202 Accepted 2026-03-09 13:29:19,718 - lava_callback - INFO - Starting async job submit for node 69aec891feb96b28aa34b6c9 2026-03-09 13:29:19,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:19,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec891feb96b28aa34b6c9 HTTP/1.1" 200 None 2026-03-09 13:29:19,759 - lava_callback - DEBUG - Processing node 69aec891feb96b28aa34b6c9: baseline-nfs-arm64 2026-03-09 13:29:20,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:20,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:20,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec891feb96b28aa34b6c9/log.txt.gz 2026-03-09 13:29:20,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:20,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:20,962 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec891feb96b28aa34b6c9/lava-logs.yaml 2026-03-09 13:29:20,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:21,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:21,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec891feb96b28aa34b6c9/lava_callback.json.gz 2026-03-09 13:29:21,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:21,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec891feb96b28aa34b6c9 HTTP/1.1" 200 None 2026-03-09 13:29:21,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:21,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:29:21,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:21,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec891feb96b28aa34b6c9 HTTP/1.1" 200 None 2026-03-09 13:29:21,291 - lava_callback - INFO - Completed processing callback for node 69aec891feb96b28aa34b6c9 INFO: 172.20.0.1:47316 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:29:34,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:34,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42672 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:29:48,756 - lava_callback - INFO - Received callback for node 69ac283640deb775998f567e INFO: 172.20.0.1:42684 - "POST /node/69ac283640deb775998f567e HTTP/1.0" 202 Accepted 2026-03-09 13:29:48,763 - lava_callback - INFO - Starting async job submit for node 69ac283640deb775998f567e 2026-03-09 13:29:48,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:48,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac283640deb775998f567e HTTP/1.1" 200 None 2026-03-09 13:29:48,782 - lava_callback - DEBUG - Processing node 69ac283640deb775998f567e: baseline-arm-clabbe 2026-03-09 13:29:48,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac283640deb775998f567e 2026-03-09 13:29:48,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:48,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac283640deb775998f567e HTTP/1.1" 200 None 2026-03-09 13:29:48,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:48,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-09 13:29:48,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:48,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac283640deb775998f567e HTTP/1.1" 200 None 2026-03-09 13:29:48,845 - lava_callback - ERROR - Error processing callback for node 69ac283640deb775998f567e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34888 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:29:55,458 - lava_callback - INFO - Received callback for node 69aec88afeb96b28aa34b6a5 INFO: 172.20.0.1:34890 - "POST /node/69aec88afeb96b28aa34b6a5 HTTP/1.0" 202 Accepted 2026-03-09 13:29:55,465 - lava_callback - INFO - Starting async job submit for node 69aec88afeb96b28aa34b6a5 2026-03-09 13:29:55,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:55,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88afeb96b28aa34b6a5 HTTP/1.1" 200 None 2026-03-09 13:29:55,513 - lava_callback - DEBUG - Processing node 69aec88afeb96b28aa34b6a5: baseline-nfs-arm64 2026-03-09 13:29:55,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:55,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:55,974 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88afeb96b28aa34b6a5/log.txt.gz 2026-03-09 13:29:56,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:56,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:56,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88afeb96b28aa34b6a5/lava-logs.yaml 2026-03-09 13:29:56,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:29:56,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:29:56,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aec88afeb96b28aa34b6a5/lava_callback.json.gz INFO: 172.20.0.1:34906 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:29:56,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:56,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec88afeb96b28aa34b6a5 HTTP/1.1" 200 None 2026-03-09 13:29:56,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:56,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:29:56,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:29:56,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec88afeb96b28aa34b6a5 HTTP/1.1" 200 None 2026-03-09 13:29:56,663 - lava_callback - INFO - Completed processing callback for node 69aec88afeb96b28aa34b6a5 2026-03-09 13:30:04,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:30:04,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40918 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:31:28,854 - lava_callback - INFO - Received callback for node 69ac28a540deb775998f56a8 INFO: 172.20.0.1:40934 - "POST /node/69ac28a540deb775998f56a8 HTTP/1.0" 202 Accepted 2026-03-09 13:31:28,859 - lava_callback - INFO - Starting async job submit for node 69ac28a540deb775998f56a8 2026-03-09 13:31:28,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:31:28,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac28a540deb775998f56a8 HTTP/1.1" 200 None 2026-03-09 13:31:28,877 - lava_callback - DEBUG - Processing node 69ac28a540deb775998f56a8: baseline-arm-clabbe 2026-03-09 13:31:28,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac28a540deb775998f56a8 2026-03-09 13:31:28,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:31:28,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac28a540deb775998f56a8 HTTP/1.1" 200 None 2026-03-09 13:31:28,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:31:28,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-09 13:31:28,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:31:28,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac28a540deb775998f56a8 HTTP/1.1" 200 None 2026-03-09 13:31:28,937 - lava_callback - ERROR - Error processing callback for node 69ac28a540deb775998f56a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34720 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:32:08,844 - lava_callback - INFO - Received callback for node 69ac28c940deb775998f56b9 INFO: 172.20.0.1:34722 - "POST /node/69ac28c940deb775998f56b9 HTTP/1.0" 202 Accepted 2026-03-09 13:32:08,850 - lava_callback - INFO - Starting async job submit for node 69ac28c940deb775998f56b9 2026-03-09 13:32:08,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:08,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac28c940deb775998f56b9 HTTP/1.1" 200 None 2026-03-09 13:32:08,866 - lava_callback - DEBUG - Processing node 69ac28c940deb775998f56b9: baseline-arm-clabbe 2026-03-09 13:32:08,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac28c940deb775998f56b9 2026-03-09 13:32:08,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:08,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac28c940deb775998f56b9 HTTP/1.1" 200 None 2026-03-09 13:32:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:08,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-09 13:32:08,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:08,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac28c940deb775998f56b9 HTTP/1.1" 200 None 2026-03-09 13:32:08,925 - lava_callback - ERROR - Error processing callback for node 69ac28c940deb775998f56b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56948 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:32:53,408 - lava_callback - INFO - Received callback for node 69ac28f240deb775998f56cc INFO: 172.20.0.1:56960 - "POST /node/69ac28f240deb775998f56cc HTTP/1.0" 202 Accepted 2026-03-09 13:32:53,414 - lava_callback - INFO - Starting async job submit for node 69ac28f240deb775998f56cc 2026-03-09 13:32:53,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:53,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac28f240deb775998f56cc HTTP/1.1" 200 None 2026-03-09 13:32:53,431 - lava_callback - DEBUG - Processing node 69ac28f240deb775998f56cc: baseline-arm64-baylibre 2026-03-09 13:32:53,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac28f240deb775998f56cc 2026-03-09 13:32:53,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:53,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac28f240deb775998f56cc HTTP/1.1" 200 None 2026-03-09 13:32:53,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:53,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:32:53,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:32:53,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac28f240deb775998f56cc HTTP/1.1" 200 None 2026-03-09 13:32:53,518 - lava_callback - ERROR - Error processing callback for node 69ac28f240deb775998f56cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50708 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:33:53,419 - lava_callback - INFO - Received callback for node 69ac293d40deb775998f56e5 INFO: 172.20.0.1:50722 - "POST /node/69ac293d40deb775998f56e5 HTTP/1.0" 202 Accepted 2026-03-09 13:33:53,424 - lava_callback - INFO - Starting async job submit for node 69ac293d40deb775998f56e5 2026-03-09 13:33:53,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:33:53,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac293d40deb775998f56e5 HTTP/1.1" 200 None 2026-03-09 13:33:53,442 - lava_callback - DEBUG - Processing node 69ac293d40deb775998f56e5: baseline-arm64-baylibre 2026-03-09 13:33:53,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac293d40deb775998f56e5 2026-03-09 13:33:53,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:33:53,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac293d40deb775998f56e5 HTTP/1.1" 200 None 2026-03-09 13:33:53,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:33:53,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:33:53,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:33:53,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac293d40deb775998f56e5 HTTP/1.1" 200 None 2026-03-09 13:33:53,514 - lava_callback - ERROR - Error processing callback for node 69ac293d40deb775998f56e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37778 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:35:13,556 - lava_callback - INFO - Received callback for node 69ac298640deb775998f56f8 INFO: 172.20.0.1:47298 - "POST /node/69ac298640deb775998f56f8 HTTP/1.0" 202 Accepted 2026-03-09 13:35:13,561 - lava_callback - INFO - Starting async job submit for node 69ac298640deb775998f56f8 2026-03-09 13:35:13,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:13,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac298640deb775998f56f8 HTTP/1.1" 200 None 2026-03-09 13:35:13,588 - lava_callback - DEBUG - Processing node 69ac298640deb775998f56f8: baseline-arm64-baylibre 2026-03-09 13:35:13,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac298640deb775998f56f8 2026-03-09 13:35:13,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:13,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac298640deb775998f56f8 HTTP/1.1" 200 None 2026-03-09 13:35:13,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:13,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:35:13,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:13,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac298640deb775998f56f8 HTTP/1.1" 200 None 2026-03-09 13:35:13,655 - lava_callback - ERROR - Error processing callback for node 69ac298640deb775998f56f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47324 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:35:21,302 - lava_callback - INFO - Received callback for node 69aecc8cfeb96b28aa34bc29 INFO: 172.20.0.1:36638 - "POST /node/69aecc8cfeb96b28aa34bc29 HTTP/1.0" 202 Accepted 2026-03-09 13:35:21,307 - lava_callback - INFO - Starting async job submit for node 69aecc8cfeb96b28aa34bc29 2026-03-09 13:35:21,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:21,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecc8cfeb96b28aa34bc29 HTTP/1.1" 200 None 2026-03-09 13:35:21,326 - lava_callback - DEBUG - Processing node 69aecc8cfeb96b28aa34bc29: baseline-arm64 2026-03-09 13:35:21,330 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:35:21,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:35:21,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:35:21,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecc8cfeb96b28aa34bc29/lava-logs.yaml 2026-03-09 13:35:21,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:35:21,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:35:21,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecc8cfeb96b28aa34bc29/lava_callback.json.gz 2026-03-09 13:35:21,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:21,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecc8cfeb96b28aa34bc29 HTTP/1.1" 200 None 2026-03-09 13:35:21,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:21,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:35:21,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:21,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecc8cfeb96b28aa34bc29 HTTP/1.1" 200 None 2026-03-09 13:35:21,741 - lava_callback - INFO - Completed processing callback for node 69aecc8cfeb96b28aa34bc29 INFO: 172.20.0.1:36648 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:35:34,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:35:34,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45070 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:36:33,627 - lava_callback - INFO - Received callback for node 69ac29d140deb775998f571d INFO: 172.20.0.1:35100 - "POST /node/69ac29d140deb775998f571d HTTP/1.0" 202 Accepted 2026-03-09 13:36:33,633 - lava_callback - INFO - Starting async job submit for node 69ac29d140deb775998f571d 2026-03-09 13:36:33,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:33,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac29d140deb775998f571d HTTP/1.1" 200 None 2026-03-09 13:36:33,650 - lava_callback - DEBUG - Processing node 69ac29d140deb775998f571d: baseline-arm64-baylibre 2026-03-09 13:36:33,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac29d140deb775998f571d 2026-03-09 13:36:33,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:33,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac29d140deb775998f571d HTTP/1.1" 200 None 2026-03-09 13:36:33,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:33,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:36:33,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:33,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac29d140deb775998f571d HTTP/1.1" 200 None 2026-03-09 13:36:33,717 - lava_callback - ERROR - Error processing callback for node 69ac29d140deb775998f571d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:36:42,857 - lava_callback - INFO - Received callback for node 69aeccdcfeb96b28aa34bc39 INFO: 172.20.0.1:60570 - "POST /node/69aeccdcfeb96b28aa34bc39 HTTP/1.0" 202 Accepted 2026-03-09 13:36:42,863 - lava_callback - INFO - Starting async job submit for node 69aeccdcfeb96b28aa34bc39 2026-03-09 13:36:42,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:42,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeccdcfeb96b28aa34bc39 HTTP/1.1" 200 None 2026-03-09 13:36:42,882 - lava_callback - DEBUG - Processing node 69aeccdcfeb96b28aa34bc39: baseline-arm64 2026-03-09 13:36:42,886 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:36:42,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:36:43,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:36:43,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeccdcfeb96b28aa34bc39/lava-logs.yaml 2026-03-09 13:36:43,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:36:43,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:36:43,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeccdcfeb96b28aa34bc39/lava_callback.json.gz 2026-03-09 13:36:43,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:43,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeccdcfeb96b28aa34bc39 HTTP/1.1" 200 None 2026-03-09 13:36:43,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:43,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:36:43,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:36:43,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeccdcfeb96b28aa34bc39 HTTP/1.1" 200 None 2026-03-09 13:36:43,246 - lava_callback - INFO - Completed processing callback for node 69aeccdcfeb96b28aa34bc39 INFO: 172.20.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38802 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:37:04,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:37:04,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42830 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:37:53,760 - lava_callback - INFO - Received callback for node 69ac2a1f40deb775998f5737 INFO: 172.20.0.1:42832 - "POST /node/69ac2a1f40deb775998f5737 HTTP/1.0" 202 Accepted 2026-03-09 13:37:53,765 - lava_callback - INFO - Starting async job submit for node 69ac2a1f40deb775998f5737 2026-03-09 13:37:53,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:37:53,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2a1f40deb775998f5737 HTTP/1.1" 200 None 2026-03-09 13:37:53,781 - lava_callback - DEBUG - Processing node 69ac2a1f40deb775998f5737: baseline-arm64-baylibre 2026-03-09 13:37:53,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2a1f40deb775998f5737 2026-03-09 13:37:53,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:37:53,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2a1f40deb775998f5737 HTTP/1.1" 200 None 2026-03-09 13:37:53,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:37:53,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:37:53,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:37:53,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2a1f40deb775998f5737 HTTP/1.1" 200 None 2026-03-09 13:37:53,842 - lava_callback - ERROR - Error processing callback for node 69ac2a1f40deb775998f5737: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54872 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:38:53,762 - lava_callback - INFO - Received callback for node 69ac2a6b40deb775998f574a INFO: 172.20.0.1:54886 - "POST /node/69ac2a6b40deb775998f574a HTTP/1.0" 202 Accepted 2026-03-09 13:38:53,767 - lava_callback - INFO - Starting async job submit for node 69ac2a6b40deb775998f574a 2026-03-09 13:38:53,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:38:53,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2a6b40deb775998f574a HTTP/1.1" 200 None 2026-03-09 13:38:53,784 - lava_callback - DEBUG - Processing node 69ac2a6b40deb775998f574a: baseline-arm64-baylibre 2026-03-09 13:38:53,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2a6b40deb775998f574a 2026-03-09 13:38:53,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:38:53,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2a6b40deb775998f574a HTTP/1.1" 200 None 2026-03-09 13:38:53,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:38:53,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:38:53,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:38:53,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2a6b40deb775998f574a HTTP/1.1" 200 None 2026-03-09 13:38:53,847 - lava_callback - ERROR - Error processing callback for node 69ac2a6b40deb775998f574a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46528 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:40:29,250 - lava_callback - INFO - Received callback for node 69ac2ab940deb775998f5766 INFO: 172.20.0.1:46532 - "POST /node/69ac2ab940deb775998f5766 HTTP/1.0" 202 Accepted 2026-03-09 13:40:29,255 - lava_callback - INFO - Starting async job submit for node 69ac2ab940deb775998f5766 2026-03-09 13:40:29,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:40:29,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2ab940deb775998f5766 HTTP/1.1" 200 None 2026-03-09 13:40:29,277 - lava_callback - DEBUG - Processing node 69ac2ab940deb775998f5766: baseline-arm64-clabbe 2026-03-09 13:40:29,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2ab940deb775998f5766 2026-03-09 13:40:29,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:40:29,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2ab940deb775998f5766 HTTP/1.1" 200 None 2026-03-09 13:40:29,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:40:29,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:40:29,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:40:29,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2ab940deb775998f5766 HTTP/1.1" 200 None 2026-03-09 13:40:29,358 - lava_callback - ERROR - Error processing callback for node 69ac2ab940deb775998f5766: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:41:13,922 - lava_callback - INFO - Received callback for node 69ac2af340deb775998f5772 INFO: 172.20.0.1:54876 - "POST /node/69ac2af340deb775998f5772 HTTP/1.0" 202 Accepted 2026-03-09 13:41:13,928 - lava_callback - INFO - Starting async job submit for node 69ac2af340deb775998f5772 2026-03-09 13:41:13,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:13,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2af340deb775998f5772 HTTP/1.1" 200 None 2026-03-09 13:41:13,944 - lava_callback - DEBUG - Processing node 69ac2af340deb775998f5772: baseline-arm-baylibre 2026-03-09 13:41:13,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2af340deb775998f5772 2026-03-09 13:41:13,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:13,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2af340deb775998f5772 HTTP/1.1" 200 None 2026-03-09 13:41:13,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:14,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-09 13:41:14,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:14,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2af340deb775998f5772 HTTP/1.1" 200 None 2026-03-09 13:41:14,033 - lava_callback - ERROR - Error processing callback for node 69ac2af340deb775998f5772: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54888 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 13:41:15,854 - lava_callback - INFO - Received callback for node 69aec8aafeb96b28aa34b73c INFO: 172.20.0.1:54898 - "POST /node/69aec8aafeb96b28aa34b73c HTTP/1.0" 202 Accepted 2026-03-09 13:41:15,861 - lava_callback - INFO - Starting async job submit for node 69aec8aafeb96b28aa34b73c 2026-03-09 13:41:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:15,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8aafeb96b28aa34b73c HTTP/1.1" 200 None 2026-03-09 13:41:15,909 - lava_callback - DEBUG - Processing node 69aec8aafeb96b28aa34b73c: baseline-arm64-broonie 2026-03-09 13:41:16,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:41:16,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:41:16,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8aafeb96b28aa34b73c/log.txt.gz INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:41:16,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:41:16,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:41:16,851 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8aafeb96b28aa34b73c/lava-logs.yaml 2026-03-09 13:41:16,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:41:17,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:41:17,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8aafeb96b28aa34b73c/lava_callback.json.gz DEBUG: Setup failed for 69aec8aafeb96b28aa34b73c. Transitting job node result: incomplete -> fail 2026-03-09 13:41:17,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:17,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8aafeb96b28aa34b73c HTTP/1.1" 200 None 2026-03-09 13:41:17,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:17,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:41:17,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:17,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8aafeb96b28aa34b73c HTTP/1.1" 200 None 2026-03-09 13:41:17,278 - lava_callback - INFO - Completed processing callback for node 69aec8aafeb96b28aa34b73c INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:41:34,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:34,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48694 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:41:53,883 - lava_callback - INFO - Received callback for node 69ac2b1640deb775998f5781 INFO: 172.20.0.1:48710 - "POST /node/69ac2b1640deb775998f5781 HTTP/1.0" 202 Accepted 2026-03-09 13:41:53,888 - lava_callback - INFO - Starting async job submit for node 69ac2b1640deb775998f5781 2026-03-09 13:41:53,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:53,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2b1640deb775998f5781 HTTP/1.1" 200 None 2026-03-09 13:41:53,909 - lava_callback - DEBUG - Processing node 69ac2b1640deb775998f5781: baseline-arm-baylibre 2026-03-09 13:41:53,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2b1640deb775998f5781 2026-03-09 13:41:53,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:53,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2b1640deb775998f5781 HTTP/1.1" 200 None 2026-03-09 13:41:53,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:53,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-09 13:41:53,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:41:53,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2b1640deb775998f5781 HTTP/1.1" 200 None 2026-03-09 13:41:53,964 - lava_callback - ERROR - Error processing callback for node 69ac2b1640deb775998f5781: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40886 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:42:32,012 - lava_callback - INFO - Received callback for node 69aece23feb96b28aa34bc8c INFO: 172.20.0.1:38764 - "POST /node/69aece23feb96b28aa34bc8c HTTP/1.0" 202 Accepted 2026-03-09 13:42:32,019 - lava_callback - INFO - Starting async job submit for node 69aece23feb96b28aa34bc8c 2026-03-09 13:42:32,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:32,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aece23feb96b28aa34bc8c HTTP/1.1" 200 None 2026-03-09 13:42:32,051 - lava_callback - DEBUG - Processing node 69aece23feb96b28aa34bc8c: baseline-arm64 2026-03-09 13:42:32,100 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:42:32,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:42:32,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:42:32,326 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aece23feb96b28aa34bc8c/lava-logs.yaml 2026-03-09 13:42:32,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:42:32,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:42:32,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aece23feb96b28aa34bc8c/lava_callback.json.gz 2026-03-09 13:42:32,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:32,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aece23feb96b28aa34bc8c HTTP/1.1" 200 None 2026-03-09 13:42:32,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:32,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:42:32,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:32,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aece23feb96b28aa34bc8c HTTP/1.1" 200 None 2026-03-09 13:42:32,597 - lava_callback - INFO - Completed processing callback for node 69aece23feb96b28aa34bc8c 2026-03-09 13:42:34,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:34,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45770 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:42:49,370 - lava_callback - INFO - Received callback for node 69ac2b4b40deb775998f5797 INFO: 172.20.0.1:45776 - "POST /node/69ac2b4b40deb775998f5797 HTTP/1.0" 202 Accepted 2026-03-09 13:42:49,375 - lava_callback - INFO - Starting async job submit for node 69ac2b4b40deb775998f5797 2026-03-09 13:42:49,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:49,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2b4b40deb775998f5797 HTTP/1.1" 200 None 2026-03-09 13:42:49,392 - lava_callback - DEBUG - Processing node 69ac2b4b40deb775998f5797: baseline-arm64-clabbe 2026-03-09 13:42:49,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2b4b40deb775998f5797 2026-03-09 13:42:49,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:49,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2b4b40deb775998f5797 HTTP/1.1" 200 None 2026-03-09 13:42:49,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:49,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ab6e44efa461f55e59cdc8 HTTP/1.1" 200 None 2026-03-09 13:42:49,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:42:49,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2b4b40deb775998f5797 HTTP/1.1" 200 None 2026-03-09 13:42:49,456 - lava_callback - ERROR - Error processing callback for node 69ac2b4b40deb775998f5797: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51606 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:43:34,064 - lava_callback - INFO - Received callback for node 69ac2b8340deb775998f57aa INFO: 172.20.0.1:33490 - "POST /node/69ac2b8340deb775998f57aa HTTP/1.0" 202 Accepted 2026-03-09 13:43:34,069 - lava_callback - INFO - Starting async job submit for node 69ac2b8340deb775998f57aa 2026-03-09 13:43:34,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:34,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2b8340deb775998f57aa HTTP/1.1" 200 None 2026-03-09 13:43:34,089 - lava_callback - DEBUG - Processing node 69ac2b8340deb775998f57aa: baseline-arm-baylibre 2026-03-09 13:43:34,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2b8340deb775998f57aa 2026-03-09 13:43:34,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:34,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2b8340deb775998f57aa HTTP/1.1" 200 None 2026-03-09 13:43:34,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:34,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-09 13:43:34,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:34,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2b8340deb775998f57aa HTTP/1.1" 200 None 2026-03-09 13:43:34,148 - lava_callback - ERROR - Error processing callback for node 69ac2b8340deb775998f57aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33494 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:43:45,676 - lava_callback - INFO - Received callback for node 69aece7bfeb96b28aa34bca0 INFO: 172.20.0.1:33730 - "POST /node/69aece7bfeb96b28aa34bca0 HTTP/1.0" 202 Accepted 2026-03-09 13:43:45,682 - lava_callback - INFO - Starting async job submit for node 69aece7bfeb96b28aa34bca0 2026-03-09 13:43:45,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:45,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aece7bfeb96b28aa34bca0 HTTP/1.1" 200 None 2026-03-09 13:43:45,699 - lava_callback - DEBUG - Processing node 69aece7bfeb96b28aa34bca0: baseline-nfs-arm64 2026-03-09 13:43:45,701 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:43:45,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:43:45,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:43:45,847 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aece7bfeb96b28aa34bca0/lava-logs.yaml 2026-03-09 13:43:45,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:43:46,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:43:46,035 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aece7bfeb96b28aa34bca0/lava_callback.json.gz 2026-03-09 13:43:46,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:46,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aece7bfeb96b28aa34bca0 HTTP/1.1" 200 None 2026-03-09 13:43:46,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:46,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:43:46,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:43:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aece7bfeb96b28aa34bca0 HTTP/1.1" 200 None 2026-03-09 13:43:46,100 - lava_callback - INFO - Completed processing callback for node 69aece7bfeb96b28aa34bca0 INFO: 172.20.0.1:33742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41156 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:44:02,221 - lava_callback - INFO - Received callback for node 69aeca86feb96b28aa34ba67 INFO: 172.20.0.1:45652 - "POST /node/69aeca86feb96b28aa34ba67 HTTP/1.0" 202 Accepted 2026-03-09 13:44:02,227 - lava_callback - INFO - Starting async job submit for node 69aeca86feb96b28aa34ba67 2026-03-09 13:44:02,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:02,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca86feb96b28aa34ba67 HTTP/1.1" 200 None 2026-03-09 13:44:02,301 - lava_callback - DEBUG - Processing node 69aeca86feb96b28aa34ba67: baseline-arm 2026-03-09 13:44:02,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:44:03,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:44:03,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aeca86feb96b28aa34ba67/log.txt.gz 2026-03-09 13:44:03,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:44:03,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:44:03,665 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aeca86feb96b28aa34ba67/lava-logs.yaml 2026-03-09 13:44:03,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:44:03,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:44:03,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aeca86feb96b28aa34ba67/lava_callback.json.gz DEBUG: Setup failed for 69aeca86feb96b28aa34ba67. Transitting job node result: incomplete -> fail 2026-03-09 13:44:03,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:03,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeca86feb96b28aa34ba67 HTTP/1.1" 200 None 2026-03-09 13:44:03,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:03,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 13:44:03,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:04,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeca86feb96b28aa34ba67 HTTP/1.1" 200 None 2026-03-09 13:44:04,136 - lava_callback - INFO - Completed processing callback for node 69aeca86feb96b28aa34ba67 2026-03-09 13:44:04,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:04,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:44:14,067 - lava_callback - INFO - Received callback for node 69ac2ba640deb775998f57ba INFO: 172.20.0.1:36906 - "POST /node/69ac2ba640deb775998f57ba HTTP/1.0" 202 Accepted 2026-03-09 13:44:14,073 - lava_callback - INFO - Starting async job submit for node 69ac2ba640deb775998f57ba 2026-03-09 13:44:14,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:14,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2ba640deb775998f57ba HTTP/1.1" 200 None 2026-03-09 13:44:14,089 - lava_callback - DEBUG - Processing node 69ac2ba640deb775998f57ba: baseline-arm-baylibre 2026-03-09 13:44:14,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2ba640deb775998f57ba 2026-03-09 13:44:14,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:14,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2ba640deb775998f57ba HTTP/1.1" 200 None 2026-03-09 13:44:14,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:14,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-09 13:44:14,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:14,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2ba640deb775998f57ba HTTP/1.1" 200 None 2026-03-09 13:44:14,142 - lava_callback - ERROR - Error processing callback for node 69ac2ba640deb775998f57ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33496 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:44:54,076 - lava_callback - INFO - Received callback for node 69ac2bcb40deb775998f57ca INFO: 172.20.0.1:33498 - "POST /node/69ac2bcb40deb775998f57ca HTTP/1.0" 202 Accepted 2026-03-09 13:44:54,082 - lava_callback - INFO - Starting async job submit for node 69ac2bcb40deb775998f57ca 2026-03-09 13:44:54,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:54,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2bcb40deb775998f57ca HTTP/1.1" 200 None 2026-03-09 13:44:54,098 - lava_callback - DEBUG - Processing node 69ac2bcb40deb775998f57ca: baseline-arm-baylibre 2026-03-09 13:44:54,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2bcb40deb775998f57ca 2026-03-09 13:44:54,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:54,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2bcb40deb775998f57ca HTTP/1.1" 200 None 2026-03-09 13:44:54,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:54,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-09 13:44:54,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:44:54,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2bcb40deb775998f57ca HTTP/1.1" 200 None 2026-03-09 13:44:54,158 - lava_callback - ERROR - Error processing callback for node 69ac2bcb40deb775998f57ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40966 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:45:25,370 - lava_callback - INFO - Received callback for node 69aecec1feb96b28aa34bcba INFO: 172.20.0.1:36672 - "POST /node/69aecec1feb96b28aa34bcba HTTP/1.0" 202 Accepted 2026-03-09 13:45:25,376 - lava_callback - INFO - Starting async job submit for node 69aecec1feb96b28aa34bcba 2026-03-09 13:45:25,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:25,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecec1feb96b28aa34bcba HTTP/1.1" 200 None 2026-03-09 13:45:25,409 - lava_callback - DEBUG - Processing node 69aecec1feb96b28aa34bcba: baseline-arm64 2026-03-09 13:45:25,462 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:45:25,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:45:25,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:45:25,707 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecec1feb96b28aa34bcba/lava-logs.yaml 2026-03-09 13:45:25,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:45:25,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:45:25,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecec1feb96b28aa34bcba/lava_callback.json.gz 2026-03-09 13:45:25,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:25,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecec1feb96b28aa34bcba HTTP/1.1" 200 None 2026-03-09 13:45:25,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:25,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:45:25,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:25,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecec1feb96b28aa34bcba HTTP/1.1" 200 None 2026-03-09 13:45:25,984 - lava_callback - INFO - Completed processing callback for node 69aecec1feb96b28aa34bcba INFO: 172.20.0.1:36686 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:45:34,113 - lava_callback - INFO - Received callback for node 69ac2bef40deb775998f57df INFO: 172.20.0.1:54578 - "POST /node/69ac2bef40deb775998f57df HTTP/1.0" 202 Accepted 2026-03-09 13:45:34,119 - lava_callback - INFO - Starting async job submit for node 69ac2bef40deb775998f57df 2026-03-09 13:45:34,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:34,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2bef40deb775998f57df HTTP/1.1" 200 None 2026-03-09 13:45:34,141 - lava_callback - DEBUG - Processing node 69ac2bef40deb775998f57df: baseline-arm-baylibre 2026-03-09 13:45:34,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac2bef40deb775998f57df 2026-03-09 13:45:34,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:34,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac2bef40deb775998f57df HTTP/1.1" 200 None 2026-03-09 13:45:34,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:34,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-09 13:45:34,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:34,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac2bef40deb775998f57df HTTP/1.1" 200 None 2026-03-09 13:45:34,212 - lava_callback - ERROR - Error processing callback for node 69ac2bef40deb775998f57df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 13:45:34,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:45:34,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47410 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:46:26,059 - lava_callback - INFO - Received callback for node 69aecf12feb96b28aa34bccb INFO: 172.20.0.1:42176 - "POST /node/69aecf12feb96b28aa34bccb HTTP/1.0" 202 Accepted 2026-03-09 13:46:26,064 - lava_callback - INFO - Starting async job submit for node 69aecf12feb96b28aa34bccb 2026-03-09 13:46:26,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:46:26,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecf12feb96b28aa34bccb HTTP/1.1" 200 None 2026-03-09 13:46:26,082 - lava_callback - DEBUG - Processing node 69aecf12feb96b28aa34bccb: baseline-arm64 2026-03-09 13:46:26,088 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:46:26,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:46:26,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:46:26,233 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecf12feb96b28aa34bccb/lava-logs.yaml 2026-03-09 13:46:26,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:46:26,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:46:26,439 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecf12feb96b28aa34bccb/lava_callback.json.gz 2026-03-09 13:46:26,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:46:26,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecf12feb96b28aa34bccb HTTP/1.1" 200 None 2026-03-09 13:46:26,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:46:26,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:46:26,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:46:26,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecf12feb96b28aa34bccb HTTP/1.1" 200 None 2026-03-09 13:46:26,503 - lava_callback - INFO - Completed processing callback for node 69aecf12feb96b28aa34bccb INFO: 172.20.0.1:42190 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:46:34,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:46:34,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56074 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:47:44,845 - lava_callback - INFO - Received callback for node 69aecf67feb96b28aa34bcdc INFO: 172.20.0.1:49852 - "POST /node/69aecf67feb96b28aa34bcdc HTTP/1.0" 202 Accepted 2026-03-09 13:47:44,850 - lava_callback - INFO - Starting async job submit for node 69aecf67feb96b28aa34bcdc 2026-03-09 13:47:44,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:47:44,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecf67feb96b28aa34bcdc HTTP/1.1" 200 None 2026-03-09 13:47:44,871 - lava_callback - DEBUG - Processing node 69aecf67feb96b28aa34bcdc: baseline-nfs-arm64 2026-03-09 13:47:44,876 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:47:44,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:47:45,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:47:45,038 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aecf67feb96b28aa34bcdc/lava-logs.yaml 2026-03-09 13:47:45,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:47:45,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:47:45,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aecf67feb96b28aa34bcdc/lava_callback.json.gz 2026-03-09 13:47:45,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:47:45,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecf67feb96b28aa34bcdc HTTP/1.1" 200 None 2026-03-09 13:47:45,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:47:45,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:47:45,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:47:45,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecf67feb96b28aa34bcdc HTTP/1.1" 200 None 2026-03-09 13:47:45,288 - lava_callback - INFO - Completed processing callback for node 69aecf67feb96b28aa34bcdc INFO: 172.20.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39260 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:48:04,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:48:04,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33646 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:48:30,618 - lava_callback - INFO - Received callback for node 69aecb08feb96b28aa34bb2f INFO: 172.20.0.1:34858 - "POST /node/69aecb08feb96b28aa34bb2f HTTP/1.0" 202 Accepted 2026-03-09 13:48:30,665 - lava_callback - INFO - Starting async job submit for node 69aecb08feb96b28aa34bb2f 2026-03-09 13:48:30,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:48:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecb08feb96b28aa34bb2f HTTP/1.1" 200 None 2026-03-09 13:48:30,704 - lava_callback - DEBUG - Processing node 69aecb08feb96b28aa34bb2f: baseline-arm-pengutronix 2026-03-09 13:48:30,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:48:30,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:48:30,985 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aecb08feb96b28aa34bb2f/log.txt.gz 2026-03-09 13:48:31,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:48:31,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:48:31,245 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aecb08feb96b28aa34bb2f/lava-logs.yaml 2026-03-09 13:48:31,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:48:31,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:48:31,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aecb08feb96b28aa34bb2f/lava_callback.json.gz DEBUG: Setup failed for 69aecb08feb96b28aa34bb2f. Transitting job node result: incomplete -> fail 2026-03-09 13:48:31,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:48:31,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecb08feb96b28aa34bb2f HTTP/1.1" 200 None 2026-03-09 13:48:31,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:48:31,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 13:48:31,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:48:31,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecb08feb96b28aa34bb2f HTTP/1.1" 200 None 2026-03-09 13:48:31,573 - lava_callback - INFO - Completed processing callback for node 69aecb08feb96b28aa34bb2f 2026-03-09 13:48:34,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:48:34,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52708 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:50:21,665 - lava_callback - INFO - Received callback for node 69aec8a9feb96b28aa34b735 INFO: 172.20.0.1:56328 - "POST /node/69aec8a9feb96b28aa34b735 HTTP/1.0" 202 Accepted 2026-03-09 13:50:21,672 - lava_callback - INFO - Starting async job submit for node 69aec8a9feb96b28aa34b735 2026-03-09 13:50:21,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:50:21,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a9feb96b28aa34b735 HTTP/1.1" 200 None 2026-03-09 13:50:21,755 - lava_callback - DEBUG - Processing node 69aec8a9feb96b28aa34b735: baseline-arm64-broonie 2026-03-09 13:50:22,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:50:22,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:50:22,342 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a9feb96b28aa34b735/log.txt.gz 2026-03-09 13:50:22,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:50:22,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:50:22,813 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a9feb96b28aa34b735/lava-logs.yaml 2026-03-09 13:50:22,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:50:23,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:50:23,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a9feb96b28aa34b735/lava_callback.json.gz DEBUG: Setup failed for 69aec8a9feb96b28aa34b735. Transitting job node result: incomplete -> fail 2026-03-09 13:50:23,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:50:23,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a9feb96b28aa34b735 HTTP/1.1" 200 None 2026-03-09 13:50:23,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:50:23,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:50:23,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:50:23,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8a9feb96b28aa34b735 HTTP/1.1" 200 None 2026-03-09 13:50:23,261 - lava_callback - INFO - Completed processing callback for node 69aec8a9feb96b28aa34b735 INFO: 172.20.0.1:56332 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:50:34,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:50:34,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38448 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:53:03,040 - lava_callback - INFO - Received callback for node 69aed0b2feb96b28aa34bd1b INFO: 172.20.0.1:55732 - "POST /node/69aed0b2feb96b28aa34bd1b HTTP/1.0" 202 Accepted 2026-03-09 13:53:03,046 - lava_callback - INFO - Starting async job submit for node 69aed0b2feb96b28aa34bd1b 2026-03-09 13:53:03,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:53:03,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed0b2feb96b28aa34bd1b HTTP/1.1" 200 None 2026-03-09 13:53:03,079 - lava_callback - DEBUG - Processing node 69aed0b2feb96b28aa34bd1b: baseline-arm64-foundriesio 2026-03-09 13:53:03,136 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:53:03,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:53:03,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:53:03,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aed0b2feb96b28aa34bd1b/lava-logs.yaml 2026-03-09 13:53:03,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:53:03,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:53:03,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aed0b2feb96b28aa34bd1b/lava_callback.json.gz 2026-03-09 13:53:03,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:53:03,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed0b2feb96b28aa34bd1b HTTP/1.1" 200 None 2026-03-09 13:53:03,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:53:03,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:53:03,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:53:03,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed0b2feb96b28aa34bd1b HTTP/1.1" 200 None 2026-03-09 13:53:03,595 - lava_callback - INFO - Completed processing callback for node 69aed0b2feb96b28aa34bd1b 2026-03-09 13:53:04,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:53:04,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41552 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:54:54,647 - lava_callback - INFO - Received callback for node 69aed0fffeb96b28aa34bd29 INFO: 172.20.0.1:41562 - "POST /node/69aed0fffeb96b28aa34bd29 HTTP/1.0" 202 Accepted 2026-03-09 13:54:54,652 - lava_callback - INFO - Starting async job submit for node 69aed0fffeb96b28aa34bd29 2026-03-09 13:54:54,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:54:54,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed0fffeb96b28aa34bd29 HTTP/1.1" 200 None 2026-03-09 13:54:54,672 - lava_callback - DEBUG - Processing node 69aed0fffeb96b28aa34bd29: baseline-arm64-broonie 2026-03-09 13:54:54,677 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:54:54,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:54:54,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:54:54,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aed0fffeb96b28aa34bd29/lava-logs.yaml 2026-03-09 13:54:54,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:54:54,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:54:54,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aed0fffeb96b28aa34bd29/lava_callback.json.gz 2026-03-09 13:54:54,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:54:55,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed0fffeb96b28aa34bd29 HTTP/1.1" 200 None 2026-03-09 13:54:55,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:54:55,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:54:55,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:54:55,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed0fffeb96b28aa34bd29 HTTP/1.1" 200 None 2026-03-09 13:54:55,052 - lava_callback - INFO - Completed processing callback for node 69aed0fffeb96b28aa34bd29 INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:55:04,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:55:04,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45400 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:55:42,828 - lava_callback - INFO - Received callback for node 69aec8b0feb96b28aa34b752 INFO: 172.20.0.1:43876 - "POST /node/69aec8b0feb96b28aa34b752 HTTP/1.0" 202 Accepted 2026-03-09 13:55:42,834 - lava_callback - INFO - Starting async job submit for node 69aec8b0feb96b28aa34b752 2026-03-09 13:55:42,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:55:42,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b0feb96b28aa34b752 HTTP/1.1" 200 None 2026-03-09 13:55:42,863 - lava_callback - DEBUG - Processing node 69aec8b0feb96b28aa34b752: baseline-arm64-broonie 2026-03-09 13:55:42,868 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:55:42,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:55:42,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:55:42,989 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8b0feb96b28aa34b752/lava-logs.yaml 2026-03-09 13:55:42,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:55:43,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:55:43,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8b0feb96b28aa34b752/lava_callback.json.gz 2026-03-09 13:55:43,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:55:43,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8b0feb96b28aa34b752 HTTP/1.1" 200 None 2026-03-09 13:55:43,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:55:43,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:55:43,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:55:43,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8b0feb96b28aa34b752 HTTP/1.1" 200 None 2026-03-09 13:55:43,177 - lava_callback - INFO - Completed processing callback for node 69aec8b0feb96b28aa34b752 INFO: 172.20.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32848 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:56:04,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:56:04,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43840 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:56:11,846 - lava_callback - INFO - Received callback for node 69aed152feb96b28aa34bd33 INFO: 172.20.0.1:43394 - "POST /node/69aed152feb96b28aa34bd33 HTTP/1.0" 202 Accepted 2026-03-09 13:56:11,852 - lava_callback - INFO - Starting async job submit for node 69aed152feb96b28aa34bd33 2026-03-09 13:56:11,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:56:11,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed152feb96b28aa34bd33 HTTP/1.1" 200 None 2026-03-09 13:56:11,870 - lava_callback - DEBUG - Processing node 69aed152feb96b28aa34bd33: baseline-arm64-clabbe 2026-03-09 13:56:11,875 - lava_callback - WARNING - Failed to upload log 2026-03-09 13:56:11,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:56:12,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:56:12,021 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69aed152feb96b28aa34bd33/lava-logs.yaml 2026-03-09 13:56:12,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 13:56:12,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 13:56:12,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69aed152feb96b28aa34bd33/lava_callback.json.gz 2026-03-09 13:56:12,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:56:12,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed152feb96b28aa34bd33 HTTP/1.1" 200 None 2026-03-09 13:56:12,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:56:12,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 13:56:12,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:56:12,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed152feb96b28aa34bd33 HTTP/1.1" 200 None 2026-03-09 13:56:12,245 - lava_callback - INFO - Completed processing callback for node 69aed152feb96b28aa34bd33 INFO: 172.20.0.1:43402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50320 - "GET / HTTP/1.0" 200 OK 2026-03-09 13:56:34,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 13:56:34,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49084 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 14:01:15,638 - lava_callback - INFO - Received callback for node 69aec8acfeb96b28aa34b74a INFO: 172.20.0.1:49090 - "POST /node/69aec8acfeb96b28aa34b74a HTTP/1.0" 202 Accepted 2026-03-09 14:01:15,644 - lava_callback - INFO - Starting async job submit for node 69aec8acfeb96b28aa34b74a 2026-03-09 14:01:15,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:15,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8acfeb96b28aa34b74a HTTP/1.1" 200 None 2026-03-09 14:01:15,695 - lava_callback - DEBUG - Processing node 69aec8acfeb96b28aa34b74a: baseline-arm64-broonie 2026-03-09 14:01:15,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:01:16,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:01:16,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8acfeb96b28aa34b74a/log.txt.gz 2026-03-09 14:01:16,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:01:16,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:01:16,460 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8acfeb96b28aa34b74a/lava-logs.yaml 2026-03-09 14:01:16,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49104 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:01:16,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:01:16,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8acfeb96b28aa34b74a/lava_callback.json.gz DEBUG: Setup failed for 69aec8acfeb96b28aa34b74a. Transitting job node result: incomplete -> fail 2026-03-09 14:01:16,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:16,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8acfeb96b28aa34b74a HTTP/1.1" 200 None 2026-03-09 14:01:16,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:16,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:01:16,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:16,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8acfeb96b28aa34b74a HTTP/1.1" 200 None 2026-03-09 14:01:16,828 - lava_callback - INFO - Completed processing callback for node 69aec8acfeb96b28aa34b74a 2026-03-09 14:01:21,335 - lava_callback - INFO - Received callback for node 69aecfb4feb96b28aa34bcf0 INFO: 172.20.0.1:49136 - "POST /node/69aecfb4feb96b28aa34bcf0 HTTP/1.0" 202 Accepted 2026-03-09 14:01:21,342 - lava_callback - INFO - Starting async job submit for node 69aecfb4feb96b28aa34bcf0 2026-03-09 14:01:21,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:21,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecfb4feb96b28aa34bcf0 HTTP/1.1" 200 None 2026-03-09 14:01:21,377 - lava_callback - DEBUG - Processing node 69aecfb4feb96b28aa34bcf0: baseline-arm64 2026-03-09 14:01:21,427 - lava_callback - WARNING - Failed to upload log 2026-03-09 14:01:21,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:01:21,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:01:21,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecfb4feb96b28aa34bcf0/lava-logs.yaml 2026-03-09 14:01:21,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:01:21,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:01:21,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aecfb4feb96b28aa34bcf0/lava_callback.json.gz 2026-03-09 14:01:21,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:21,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aecfb4feb96b28aa34bcf0 HTTP/1.1" 200 None 2026-03-09 14:01:21,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:21,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:01:21,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:21,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aecfb4feb96b28aa34bcf0 HTTP/1.1" 200 None 2026-03-09 14:01:21,871 - lava_callback - INFO - Completed processing callback for node 69aecfb4feb96b28aa34bcf0 INFO: 172.20.0.1:49146 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:01:34,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:01:34,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53856 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:06:16,710 - lava_callback - INFO - Received callback for node 69aed37cfeb96b28aa34bd91 INFO: 172.20.0.1:53858 - "POST /node/69aed37cfeb96b28aa34bd91 HTTP/1.0" 202 Accepted 2026-03-09 14:06:16,717 - lava_callback - INFO - Starting async job submit for node 69aed37cfeb96b28aa34bd91 2026-03-09 14:06:16,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:06:16,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed37cfeb96b28aa34bd91 HTTP/1.1" 200 None 2026-03-09 14:06:16,764 - lava_callback - DEBUG - Processing node 69aed37cfeb96b28aa34bd91: baseline-nfs-arm64 2026-03-09 14:06:17,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:06:17,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:06:17,376 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed37cfeb96b28aa34bd91/log.txt.gz 2026-03-09 14:06:17,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:06:17,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:06:17,879 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed37cfeb96b28aa34bd91/lava-logs.yaml 2026-03-09 14:06:17,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:06:18,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:06:18,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed37cfeb96b28aa34bd91/lava_callback.json.gz DEBUG: Setup failed for 69aed37cfeb96b28aa34bd91. Transitting job node result: incomplete -> fail 2026-03-09 14:06:18,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:06:18,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed37cfeb96b28aa34bd91 HTTP/1.1" 200 None 2026-03-09 14:06:18,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:06:18,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:06:18,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:06:18,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed37cfeb96b28aa34bd91 HTTP/1.1" 200 None 2026-03-09 14:06:18,229 - lava_callback - INFO - Completed processing callback for node 69aed37cfeb96b28aa34bd91 INFO: 172.20.0.1:57412 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:06:34,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:06:34,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34160 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:09:06,877 - lava_callback - INFO - Received callback for node 69aed417feb96b28aa34bda6 INFO: 172.20.0.1:34168 - "POST /node/69aed417feb96b28aa34bda6 HTTP/1.0" 202 Accepted 2026-03-09 14:09:06,883 - lava_callback - INFO - Starting async job submit for node 69aed417feb96b28aa34bda6 2026-03-09 14:09:06,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:09:06,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed417feb96b28aa34bda6 HTTP/1.1" 200 None 2026-03-09 14:09:06,929 - lava_callback - DEBUG - Processing node 69aed417feb96b28aa34bda6: baseline-arm64 2026-03-09 14:09:07,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:09:07,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:09:07,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed417feb96b28aa34bda6/log.txt.gz 2026-03-09 14:09:07,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:09:07,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:09:07,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed417feb96b28aa34bda6/lava-logs.yaml 2026-03-09 14:09:07,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:09:08,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:09:08,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed417feb96b28aa34bda6/lava_callback.json.gz DEBUG: Setup failed for 69aed417feb96b28aa34bda6. Transitting job node result: incomplete -> fail 2026-03-09 14:09:08,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:09:08,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed417feb96b28aa34bda6 HTTP/1.1" 200 None 2026-03-09 14:09:08,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:09:08,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:09:08,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:09:08,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed417feb96b28aa34bda6 HTTP/1.1" 200 None 2026-03-09 14:09:08,321 - lava_callback - INFO - Completed processing callback for node 69aed417feb96b28aa34bda6 INFO: 172.20.0.1:49226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47894 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:09:34,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:09:34,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34006 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:10:04,109 - lava_callback - INFO - Received callback for node 69aed467feb96b28aa34bdaf INFO: 172.20.0.1:52974 - "POST /node/69aed467feb96b28aa34bdaf HTTP/1.0" 202 Accepted 2026-03-09 14:10:04,116 - lava_callback - INFO - Starting async job submit for node 69aed467feb96b28aa34bdaf 2026-03-09 14:10:04,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:10:04,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed467feb96b28aa34bdaf HTTP/1.1" 200 None 2026-03-09 14:10:04,162 - lava_callback - DEBUG - Processing node 69aed467feb96b28aa34bdaf: baseline-arm64 2026-03-09 14:10:04,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:10:04,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:10:04,684 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed467feb96b28aa34bdaf/log.txt.gz 2026-03-09 14:10:04,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:10:05,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:10:05,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed467feb96b28aa34bdaf/lava-logs.yaml 2026-03-09 14:10:05,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:10:05,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:10:05,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed467feb96b28aa34bdaf/lava_callback.json.gz DEBUG: Setup failed for 69aed467feb96b28aa34bdaf. Transitting job node result: incomplete -> fail 2026-03-09 14:10:05,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:10:05,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed467feb96b28aa34bdaf HTTP/1.1" 200 None 2026-03-09 14:10:05,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:10:05,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:10:05,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:10:05,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed467feb96b28aa34bdaf HTTP/1.1" 200 None 2026-03-09 14:10:05,520 - lava_callback - INFO - Completed processing callback for node 69aed467feb96b28aa34bdaf INFO: 172.20.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42300 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:10:34,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:10:34,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:13:15,021 - lava_callback - INFO - Received callback for node 69aed51cfeb96b28aa34bdcd INFO: 172.20.0.1:40116 - "POST /node/69aed51cfeb96b28aa34bdcd HTTP/1.0" 202 Accepted 2026-03-09 14:13:15,029 - lava_callback - INFO - Starting async job submit for node 69aed51cfeb96b28aa34bdcd 2026-03-09 14:13:15,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:13:15,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed51cfeb96b28aa34bdcd HTTP/1.1" 200 None 2026-03-09 14:13:15,077 - lava_callback - DEBUG - Processing node 69aed51cfeb96b28aa34bdcd: baseline-arm64-foundriesio INFO: 172.20.0.1:40126 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 14:13:15,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:13:15,467 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:13:15,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aed51cfeb96b28aa34bdcd/log.txt.gz 2026-03-09 14:13:15,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:13:15,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:13:15,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aed51cfeb96b28aa34bdcd/lava-logs.yaml 2026-03-09 14:13:15,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:13:15,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:13:15,959 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aed51cfeb96b28aa34bdcd/lava_callback.json.gz DEBUG: Setup failed for 69aed51cfeb96b28aa34bdcd. Transitting job node result: incomplete -> fail 2026-03-09 14:13:16,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:13:16,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed51cfeb96b28aa34bdcd HTTP/1.1" 200 None 2026-03-09 14:13:16,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:13:16,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:13:16,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:13:16,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed51cfeb96b28aa34bdcd HTTP/1.1" 200 None 2026-03-09 14:13:16,145 - lava_callback - INFO - Completed processing callback for node 69aed51cfeb96b28aa34bdcd INFO: 172.20.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:13:34,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:13:34,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54208 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:14:54,233 - lava_callback - INFO - Received callback for node 69aed55dfeb96b28aa34bdd5 INFO: 172.20.0.1:54216 - "POST /node/69aed55dfeb96b28aa34bdd5 HTTP/1.0" 202 Accepted 2026-03-09 14:14:54,239 - lava_callback - INFO - Starting async job submit for node 69aed55dfeb96b28aa34bdd5 2026-03-09 14:14:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:14:54,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed55dfeb96b28aa34bdd5 HTTP/1.1" 200 None 2026-03-09 14:14:54,286 - lava_callback - DEBUG - Processing node 69aed55dfeb96b28aa34bdd5: baseline-nfs-arm64 2026-03-09 14:14:54,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:14:54,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:14:54,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed55dfeb96b28aa34bdd5/log.txt.gz 2026-03-09 14:14:55,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:14:55,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:14:55,342 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed55dfeb96b28aa34bdd5/lava-logs.yaml 2026-03-09 14:14:55,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:14:55,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:14:55,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed55dfeb96b28aa34bdd5/lava_callback.json.gz DEBUG: Setup failed for 69aed55dfeb96b28aa34bdd5. Transitting job node result: incomplete -> fail 2026-03-09 14:14:55,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:14:55,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed55dfeb96b28aa34bdd5 HTTP/1.1" 200 None 2026-03-09 14:14:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:14:55,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:14:55,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:14:55,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed55dfeb96b28aa34bdd5 HTTP/1.1" 200 None 2026-03-09 14:14:55,733 - lava_callback - INFO - Completed processing callback for node 69aed55dfeb96b28aa34bdd5 INFO: 172.20.0.1:54222 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:15:04,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:15:04,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:18:43,302 - lava_callback - INFO - Received callback for node 69aed193feb96b28aa34bd44 INFO: 172.20.0.1:59102 - "POST /node/69aed193feb96b28aa34bd44 HTTP/1.0" 202 Accepted 2026-03-09 14:18:43,308 - lava_callback - INFO - Starting async job submit for node 69aed193feb96b28aa34bd44 2026-03-09 14:18:43,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:18:43,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed193feb96b28aa34bd44 HTTP/1.1" 200 None 2026-03-09 14:18:43,353 - lava_callback - DEBUG - Processing node 69aed193feb96b28aa34bd44: baseline-arm64 2026-03-09 14:18:43,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:18:43,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:18:43,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed193feb96b28aa34bd44/log.txt.gz 2026-03-09 14:18:43,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:18:44,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:18:44,167 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed193feb96b28aa34bd44/lava-logs.yaml 2026-03-09 14:18:44,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:18:44,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:18:44,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed193feb96b28aa34bd44/lava_callback.json.gz DEBUG: Setup failed for 69aed193feb96b28aa34bd44. Transitting job node result: incomplete -> fail 2026-03-09 14:18:44,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:18:44,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed193feb96b28aa34bd44 HTTP/1.1" 200 None 2026-03-09 14:18:44,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:18:44,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:18:44,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:18:44,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed193feb96b28aa34bd44 HTTP/1.1" 200 None 2026-03-09 14:18:44,535 - lava_callback - INFO - Completed processing callback for node 69aed193feb96b28aa34bd44 INFO: 172.20.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37450 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:19:04,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:19:04,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54480 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:19:23,564 - lava_callback - INFO - Received callback for node 69aed325feb96b28aa34bd85 INFO: 172.20.0.1:44652 - "POST /node/69aed325feb96b28aa34bd85 HTTP/1.0" 202 Accepted 2026-03-09 14:19:23,571 - lava_callback - INFO - Starting async job submit for node 69aed325feb96b28aa34bd85 2026-03-09 14:19:23,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:19:23,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed325feb96b28aa34bd85 HTTP/1.1" 200 None 2026-03-09 14:19:23,617 - lava_callback - DEBUG - Processing node 69aed325feb96b28aa34bd85: baseline-arm64 2026-03-09 14:19:24,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:19:24,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:19:24,296 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed325feb96b28aa34bd85/log.txt.gz 2026-03-09 14:19:24,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:19:24,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:19:24,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed325feb96b28aa34bd85/lava-logs.yaml 2026-03-09 14:19:24,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:19:25,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:19:25,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed325feb96b28aa34bd85/lava_callback.json.gz DEBUG: Setup failed for 69aed325feb96b28aa34bd85. Transitting job node result: incomplete -> fail 2026-03-09 14:19:25,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:19:25,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed325feb96b28aa34bd85 HTTP/1.1" 200 None 2026-03-09 14:19:25,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:19:25,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:19:25,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:19:25,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed325feb96b28aa34bd85 HTTP/1.1" 200 None 2026-03-09 14:19:25,257 - lava_callback - INFO - Completed processing callback for node 69aed325feb96b28aa34bd85 INFO: 172.20.0.1:44664 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:19:34,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:19:35,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:20:42,355 - lava_callback - INFO - Received callback for node 69aed5a3feb96b28aa34bde0 INFO: 172.20.0.1:35256 - "POST /node/69aed5a3feb96b28aa34bde0 HTTP/1.0" 202 Accepted 2026-03-09 14:20:42,361 - lava_callback - INFO - Starting async job submit for node 69aed5a3feb96b28aa34bde0 2026-03-09 14:20:42,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:20:42,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed5a3feb96b28aa34bde0 HTTP/1.1" 200 None 2026-03-09 14:20:42,408 - lava_callback - DEBUG - Processing node 69aed5a3feb96b28aa34bde0: baseline-arm64 2026-03-09 14:20:42,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:20:42,933 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:20:42,935 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed5a3feb96b28aa34bde0/log.txt.gz 2026-03-09 14:20:43,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:20:43,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:20:43,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed5a3feb96b28aa34bde0/lava-logs.yaml 2026-03-09 14:20:43,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:20:43,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:20:43,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed5a3feb96b28aa34bde0/lava_callback.json.gz DEBUG: Setup failed for 69aed5a3feb96b28aa34bde0. Transitting job node result: incomplete -> fail 2026-03-09 14:20:43,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:20:43,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed5a3feb96b28aa34bde0 HTTP/1.1" 200 None 2026-03-09 14:20:43,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:20:43,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:20:43,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:20:43,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed5a3feb96b28aa34bde0 HTTP/1.1" 200 None 2026-03-09 14:20:43,810 - lava_callback - INFO - Completed processing callback for node 69aed5a3feb96b28aa34bde0 INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50490 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:21:05,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:05,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:21:13,310 - lava_callback - INFO - Received callback for node 69aed3ccfeb96b28aa34bd97 INFO: 172.20.0.1:35634 - "POST /node/69aed3ccfeb96b28aa34bd97 HTTP/1.0" 202 Accepted 2026-03-09 14:21:13,317 - lava_callback - INFO - Starting async job submit for node 69aed3ccfeb96b28aa34bd97 2026-03-09 14:21:13,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:13,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed3ccfeb96b28aa34bd97 HTTP/1.1" 200 None 2026-03-09 14:21:13,365 - lava_callback - DEBUG - Processing node 69aed3ccfeb96b28aa34bd97: baseline-nfs-arm64 2026-03-09 14:21:13,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:13,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:13,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed3ccfeb96b28aa34bd97/log.txt.gz 2026-03-09 14:21:14,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:14,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:14,243 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed3ccfeb96b28aa34bd97/lava-logs.yaml 2026-03-09 14:21:14,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:14,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:14,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed3ccfeb96b28aa34bd97/lava_callback.json.gz DEBUG: Setup failed for 69aed3ccfeb96b28aa34bd97. Transitting job node result: incomplete -> fail 2026-03-09 14:21:14,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:14,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed3ccfeb96b28aa34bd97 HTTP/1.1" 200 None 2026-03-09 14:21:14,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:14,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:21:14,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:14,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed3ccfeb96b28aa34bd97 HTTP/1.1" 200 None 2026-03-09 14:21:14,604 - lava_callback - INFO - Completed processing callback for node 69aed3ccfeb96b28aa34bd97 INFO: 172.20.0.1:35636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47456 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:21:35,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:35,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55634 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:21:41,947 - lava_callback - INFO - Received callback for node 69aed1e2feb96b28aa34bd4f INFO: 172.20.0.1:34886 - "POST /node/69aed1e2feb96b28aa34bd4f HTTP/1.0" 202 Accepted 2026-03-09 14:21:41,953 - lava_callback - INFO - Starting async job submit for node 69aed1e2feb96b28aa34bd4f 2026-03-09 14:21:41,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:42,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed1e2feb96b28aa34bd4f HTTP/1.1" 200 None 2026-03-09 14:21:42,001 - lava_callback - DEBUG - Processing node 69aed1e2feb96b28aa34bd4f: baseline-arm64 2026-03-09 14:21:42,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:42,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:42,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed1e2feb96b28aa34bd4f/log.txt.gz 2026-03-09 14:21:42,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:42,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:42,952 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed1e2feb96b28aa34bd4f/lava-logs.yaml 2026-03-09 14:21:42,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:43,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:43,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed1e2feb96b28aa34bd4f/lava_callback.json.gz DEBUG: Setup failed for 69aed1e2feb96b28aa34bd4f. Transitting job node result: incomplete -> fail 2026-03-09 14:21:43,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:43,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed1e2feb96b28aa34bd4f HTTP/1.1" 200 None 2026-03-09 14:21:43,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:43,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:21:43,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:43,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed1e2feb96b28aa34bd4f HTTP/1.1" 200 None 2026-03-09 14:21:43,295 - lava_callback - INFO - Completed processing callback for node 69aed1e2feb96b28aa34bd4f INFO: 172.20.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:21:55,312 - lava_callback - INFO - Received callback for node 69aed28bfeb96b28aa34bd67 INFO: 172.20.0.1:56136 - "POST /node/69aed28bfeb96b28aa34bd67 HTTP/1.0" 202 Accepted 2026-03-09 14:21:55,319 - lava_callback - INFO - Starting async job submit for node 69aed28bfeb96b28aa34bd67 2026-03-09 14:21:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:55,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed28bfeb96b28aa34bd67 HTTP/1.1" 200 None 2026-03-09 14:21:55,365 - lava_callback - DEBUG - Processing node 69aed28bfeb96b28aa34bd67: baseline-nfs-arm64 2026-03-09 14:21:55,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:55,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:55,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed28bfeb96b28aa34bd67/log.txt.gz 2026-03-09 14:21:56,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:21:56,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:56,409 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed28bfeb96b28aa34bd67/lava-logs.yaml 2026-03-09 14:21:56,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56144 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:21:56,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:21:56,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed28bfeb96b28aa34bd67/lava_callback.json.gz DEBUG: Setup failed for 69aed28bfeb96b28aa34bd67. Transitting job node result: incomplete -> fail 2026-03-09 14:21:56,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:56,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed28bfeb96b28aa34bd67 HTTP/1.1" 200 None 2026-03-09 14:21:56,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:56,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:21:56,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:21:56,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed28bfeb96b28aa34bd67 HTTP/1.1" 200 None 2026-03-09 14:21:56,761 - lava_callback - INFO - Completed processing callback for node 69aed28bfeb96b28aa34bd67 2026-03-09 14:22:05,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:22:05,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:23:40,794 - lava_callback - INFO - Received callback for node 69aed64afeb96b28aa34bdf8 INFO: 172.20.0.1:56656 - "POST /node/69aed64afeb96b28aa34bdf8 HTTP/1.0" 202 Accepted 2026-03-09 14:23:40,809 - lava_callback - INFO - Starting async job submit for node 69aed64afeb96b28aa34bdf8 2026-03-09 14:23:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:40,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed64afeb96b28aa34bdf8 HTTP/1.1" 200 None 2026-03-09 14:23:40,908 - lava_callback - DEBUG - Processing node 69aed64afeb96b28aa34bdf8: baseline-nfs-arm64 2026-03-09 14:23:41,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:23:41,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:23:41,851 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed64afeb96b28aa34bdf8/log.txt.gz 2026-03-09 14:23:42,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:23:42,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:23:42,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed64afeb96b28aa34bdf8/lava-logs.yaml 2026-03-09 14:23:42,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:23:42,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:23:42,831 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed64afeb96b28aa34bdf8/lava_callback.json.gz DEBUG: Setup failed for 69aed64afeb96b28aa34bdf8. Transitting job node result: incomplete -> fail 2026-03-09 14:23:42,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:42,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed64afeb96b28aa34bdf8 HTTP/1.1" 200 None 2026-03-09 14:23:42,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:42,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:23:42,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:43,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed64afeb96b28aa34bdf8 HTTP/1.1" 200 None 2026-03-09 14:23:43,183 - lava_callback - INFO - Completed processing callback for node 69aed64afeb96b28aa34bdf8 2026-03-09 14:23:43,225 - lava_callback - INFO - Received callback for node 69aed4b9feb96b28aa34bdbb INFO: 172.20.0.1:56672 - "POST /node/69aed4b9feb96b28aa34bdbb HTTP/1.0" 202 Accepted 2026-03-09 14:23:43,241 - lava_callback - INFO - Starting async job submit for node 69aed4b9feb96b28aa34bdbb 2026-03-09 14:23:43,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:43,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed4b9feb96b28aa34bdbb HTTP/1.1" 200 None 2026-03-09 14:23:43,320 - lava_callback - DEBUG - Processing node 69aed4b9feb96b28aa34bdbb: baseline-nfs-arm64 2026-03-09 14:23:44,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:23:44,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:23:44,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed4b9feb96b28aa34bdbb/log.txt.gz 2026-03-09 14:23:45,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:23:45,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:23:45,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed4b9feb96b28aa34bdbb/lava-logs.yaml 2026-03-09 14:23:45,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:23:45,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:23:45,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed4b9feb96b28aa34bdbb/lava_callback.json.gz DEBUG: Setup failed for 69aed4b9feb96b28aa34bdbb. Transitting job node result: incomplete -> fail 2026-03-09 14:23:45,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:46,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed4b9feb96b28aa34bdbb HTTP/1.1" 200 None 2026-03-09 14:23:46,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:46,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:23:46,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:23:46,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed4b9feb96b28aa34bdbb HTTP/1.1" 200 None 2026-03-09 14:23:46,165 - lava_callback - INFO - Completed processing callback for node 69aed4b9feb96b28aa34bdbb INFO: 172.20.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36326 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:24:05,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:24:05,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60626 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:35:37,608 - lava_callback - INFO - Received callback for node 69aed692feb96b28aa34bdfe INFO: 172.20.0.1:60642 - "POST /node/69aed692feb96b28aa34bdfe HTTP/1.0" 202 Accepted 2026-03-09 14:35:37,615 - lava_callback - INFO - Starting async job submit for node 69aed692feb96b28aa34bdfe 2026-03-09 14:35:37,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:37,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed692feb96b28aa34bdfe HTTP/1.1" 200 None 2026-03-09 14:35:37,722 - lava_callback - DEBUG - Processing node 69aed692feb96b28aa34bdfe: ltp-smoke 2026-03-09 14:35:38,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:35:38,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:35:38,355 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69aed692feb96b28aa34bdfe/log.txt.gz 2026-03-09 14:35:38,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:35:38,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:35:38,868 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69aed692feb96b28aa34bdfe/lava-logs.yaml 2026-03-09 14:35:38,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:35:39,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:35:39,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69aed692feb96b28aa34bdfe/lava_callback.json.gz 2026-03-09 14:35:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:39,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed692feb96b28aa34bdfe HTTP/1.1" 200 None 2026-03-09 14:35:39,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:39,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba38feb96b28aa34a77b HTTP/1.1" 200 None 2026-03-09 14:35:39,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:39,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed692feb96b28aa34bdfe HTTP/1.1" 200 None 2026-03-09 14:35:39,358 - lava_callback - INFO - Completed processing callback for node 69aed692feb96b28aa34bdfe INFO: 172.20.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49340 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:35:54,763 - lava_callback - INFO - Received callback for node 69aed232feb96b28aa34bd5b INFO: 172.20.0.1:49356 - "POST /node/69aed232feb96b28aa34bd5b HTTP/1.0" 202 Accepted 2026-03-09 14:35:54,770 - lava_callback - INFO - Starting async job submit for node 69aed232feb96b28aa34bd5b 2026-03-09 14:35:54,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:54,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed232feb96b28aa34bd5b HTTP/1.1" 200 None 2026-03-09 14:35:54,817 - lava_callback - DEBUG - Processing node 69aed232feb96b28aa34bd5b: baseline-arm64 2026-03-09 14:35:55,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:35:55,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:35:55,763 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed232feb96b28aa34bd5b/log.txt.gz 2026-03-09 14:35:56,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:35:56,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:35:56,479 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed232feb96b28aa34bd5b/lava-logs.yaml 2026-03-09 14:35:56,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49366 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:35:56,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:35:56,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed232feb96b28aa34bd5b/lava_callback.json.gz DEBUG: Setup failed for 69aed232feb96b28aa34bd5b. Transitting job node result: incomplete -> fail 2026-03-09 14:35:56,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:56,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed232feb96b28aa34bd5b HTTP/1.1" 200 None 2026-03-09 14:35:56,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:56,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:35:56,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:35:56,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed232feb96b28aa34bd5b HTTP/1.1" 200 None 2026-03-09 14:35:56,853 - lava_callback - INFO - Completed processing callback for node 69aed232feb96b28aa34bd5b 2026-03-09 14:36:05,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:05,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55640 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:36:28,896 - lava_callback - INFO - Received callback for node 69aed2dafeb96b28aa34bd79 INFO: 172.20.0.1:55650 - "POST /node/69aed2dafeb96b28aa34bd79 HTTP/1.0" 202 Accepted 2026-03-09 14:36:28,903 - lava_callback - INFO - Starting async job submit for node 69aed2dafeb96b28aa34bd79 2026-03-09 14:36:28,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:28,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed2dafeb96b28aa34bd79 HTTP/1.1" 200 None 2026-03-09 14:36:28,952 - lava_callback - DEBUG - Processing node 69aed2dafeb96b28aa34bd79: baseline-nfs-arm64 2026-03-09 14:36:29,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:36:29,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:36:30,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed2dafeb96b28aa34bd79/log.txt.gz 2026-03-09 14:36:30,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:36:30,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:36:30,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed2dafeb96b28aa34bd79/lava-logs.yaml 2026-03-09 14:36:30,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:36:30,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:36:30,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed2dafeb96b28aa34bd79/lava_callback.json.gz DEBUG: Setup failed for 69aed2dafeb96b28aa34bd79. Transitting job node result: incomplete -> fail 2026-03-09 14:36:30,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:31,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed2dafeb96b28aa34bd79 HTTP/1.1" 200 None 2026-03-09 14:36:31,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:31,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:36:31,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:31,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed2dafeb96b28aa34bd79 HTTP/1.1" 200 None 2026-03-09 14:36:31,120 - lava_callback - INFO - Completed processing callback for node 69aed2dafeb96b28aa34bd79 2026-03-09 14:36:35,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:35,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49450 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:36:52,643 - lava_callback - INFO - Received callback for node 69aed86dfeb96b28aa34be6b INFO: 172.20.0.1:56422 - "POST /node/69aed86dfeb96b28aa34be6b HTTP/1.0" 202 Accepted 2026-03-09 14:36:52,649 - lava_callback - INFO - Starting async job submit for node 69aed86dfeb96b28aa34be6b 2026-03-09 14:36:52,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:52,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed86dfeb96b28aa34be6b HTTP/1.1" 200 None 2026-03-09 14:36:52,713 - lava_callback - DEBUG - Processing node 69aed86dfeb96b28aa34be6b: baseline-arm64 2026-03-09 14:36:53,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:36:53,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:36:53,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed86dfeb96b28aa34be6b/log.txt.gz 2026-03-09 14:36:53,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:36:53,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:36:53,516 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed86dfeb96b28aa34be6b/lava-logs.yaml 2026-03-09 14:36:53,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:36:53,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:36:53,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed86dfeb96b28aa34be6b/lava_callback.json.gz 2026-03-09 14:36:53,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:53,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed86dfeb96b28aa34be6b HTTP/1.1" 200 None 2026-03-09 14:36:53,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:53,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:36:53,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:36:53,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed86dfeb96b28aa34be6b HTTP/1.1" 200 None 2026-03-09 14:36:53,820 - lava_callback - INFO - Completed processing callback for node 69aed86dfeb96b28aa34be6b INFO: 172.20.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:37:05,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:37:05,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45212 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:37:36,741 - lava_callback - INFO - Received callback for node 69aec8a3feb96b28aa34b6eb INFO: 172.20.0.1:45220 - "POST /node/69aec8a3feb96b28aa34b6eb HTTP/1.0" 202 Accepted 2026-03-09 14:37:36,747 - lava_callback - INFO - Starting async job submit for node 69aec8a3feb96b28aa34b6eb 2026-03-09 14:37:36,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:37:36,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a3feb96b28aa34b6eb HTTP/1.1" 200 None 2026-03-09 14:37:36,797 - lava_callback - DEBUG - Processing node 69aec8a3feb96b28aa34b6eb: baseline-arm64-broonie 2026-03-09 14:37:37,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:37:37,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:37:37,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a3feb96b28aa34b6eb/log.txt.gz 2026-03-09 14:37:37,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:37:37,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:37:37,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a3feb96b28aa34b6eb/lava-logs.yaml 2026-03-09 14:37:37,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:37:37,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:37:37,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a3feb96b28aa34b6eb/lava_callback.json.gz DEBUG: Setup failed for 69aec8a3feb96b28aa34b6eb. Transitting job node result: incomplete -> fail 2026-03-09 14:37:37,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:37:37,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a3feb96b28aa34b6eb HTTP/1.1" 200 None 2026-03-09 14:37:37,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:37:37,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:37:37,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:37:37,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8a3feb96b28aa34b6eb HTTP/1.1" 200 None 2026-03-09 14:37:37,895 - lava_callback - INFO - Completed processing callback for node 69aec8a3feb96b28aa34b6eb INFO: 172.20.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59822 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:38:05,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:38:05,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51662 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:39:04,177 - lava_callback - INFO - Received callback for node 69aedb75feb96b28aa34bede INFO: 172.20.0.1:44038 - "POST /node/69aedb75feb96b28aa34bede HTTP/1.0" 202 Accepted 2026-03-09 14:39:04,182 - lava_callback - INFO - Starting async job submit for node 69aedb75feb96b28aa34bede 2026-03-09 14:39:04,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:04,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedb75feb96b28aa34bede HTTP/1.1" 200 None 2026-03-09 14:39:04,202 - lava_callback - DEBUG - Processing node 69aedb75feb96b28aa34bede: baseline-arm64 2026-03-09 14:39:04,206 - lava_callback - WARNING - Failed to upload log 2026-03-09 14:39:04,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:39:04,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:39:04,409 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aedb75feb96b28aa34bede/lava-logs.yaml 2026-03-09 14:39:04,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:39:04,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:39:04,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aedb75feb96b28aa34bede/lava_callback.json.gz 2026-03-09 14:39:04,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:04,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedb75feb96b28aa34bede HTTP/1.1" 200 None 2026-03-09 14:39:04,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:04,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:39:04,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:04,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedb75feb96b28aa34bede HTTP/1.1" 200 None 2026-03-09 14:39:04,662 - lava_callback - INFO - Completed processing callback for node 69aedb75feb96b28aa34bede 2026-03-09 14:39:05,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:05,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:39:40,427 - lava_callback - INFO - Received callback for node 69aed90dfeb96b28aa34be7b INFO: 172.20.0.1:39470 - "POST /node/69aed90dfeb96b28aa34be7b HTTP/1.0" 202 Accepted 2026-03-09 14:39:40,433 - lava_callback - INFO - Starting async job submit for node 69aed90dfeb96b28aa34be7b 2026-03-09 14:39:40,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:40,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed90dfeb96b28aa34be7b HTTP/1.1" 200 None 2026-03-09 14:39:40,486 - lava_callback - DEBUG - Processing node 69aed90dfeb96b28aa34be7b: baseline-nfs-arm64 2026-03-09 14:39:40,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:39:40,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:39:40,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed90dfeb96b28aa34be7b/log.txt.gz 2026-03-09 14:39:41,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:39:41,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:39:41,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed90dfeb96b28aa34be7b/lava-logs.yaml 2026-03-09 14:39:41,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:39:41,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:39:41,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed90dfeb96b28aa34be7b/lava_callback.json.gz 2026-03-09 14:39:41,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:41,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed90dfeb96b28aa34be7b HTTP/1.1" 200 None 2026-03-09 14:39:41,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:41,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:39:41,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:39:41,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed90dfeb96b28aa34be7b HTTP/1.1" 200 None 2026-03-09 14:39:41,693 - lava_callback - INFO - Completed processing callback for node 69aed90dfeb96b28aa34be7b INFO: 172.20.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46070 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:40:05,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:40:05,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38870 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:40:57,285 - lava_callback - INFO - Received callback for node 69aec8a4feb96b28aa34b722 INFO: 172.20.0.1:38880 - "POST /node/69aec8a4feb96b28aa34b722 HTTP/1.0" 202 Accepted 2026-03-09 14:40:57,291 - lava_callback - INFO - Starting async job submit for node 69aec8a4feb96b28aa34b722 2026-03-09 14:40:57,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:40:57,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a4feb96b28aa34b722 HTTP/1.1" 200 None 2026-03-09 14:40:57,341 - lava_callback - DEBUG - Processing node 69aec8a4feb96b28aa34b722: baseline-arm64-broonie 2026-03-09 14:40:57,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:40:57,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:40:57,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a4feb96b28aa34b722/log.txt.gz 2026-03-09 14:40:57,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:40:58,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:40:58,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a4feb96b28aa34b722/lava-logs.yaml 2026-03-09 14:40:58,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:40:58,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:40:58,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a4feb96b28aa34b722/lava_callback.json.gz DEBUG: Setup failed for 69aec8a4feb96b28aa34b722. Transitting job node result: incomplete -> fail 2026-03-09 14:40:58,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:40:58,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a4feb96b28aa34b722 HTTP/1.1" 200 None 2026-03-09 14:40:58,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:40:58,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:40:58,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:40:58,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8a4feb96b28aa34b722 HTTP/1.1" 200 None 2026-03-09 14:40:58,546 - lava_callback - INFO - Completed processing callback for node 69aec8a4feb96b28aa34b722 2026-03-09 14:41:05,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:41:05,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:41:24,843 - lava_callback - INFO - Received callback for node 69aedc0efeb96b28aa34bf01 INFO: 172.20.0.1:37020 - "POST /node/69aedc0efeb96b28aa34bf01 HTTP/1.0" 202 Accepted 2026-03-09 14:41:24,851 - lava_callback - INFO - Starting async job submit for node 69aedc0efeb96b28aa34bf01 2026-03-09 14:41:24,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:41:24,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedc0efeb96b28aa34bf01 HTTP/1.1" 200 None 2026-03-09 14:41:24,869 - lava_callback - DEBUG - Processing node 69aedc0efeb96b28aa34bf01: baseline-arm64 2026-03-09 14:41:24,873 - lava_callback - WARNING - Failed to upload log 2026-03-09 14:41:24,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:41:25,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:41:25,023 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aedc0efeb96b28aa34bf01/lava-logs.yaml 2026-03-09 14:41:25,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 14:41:25,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 14:41:25,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aedc0efeb96b28aa34bf01/lava_callback.json.gz 2026-03-09 14:41:25,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:41:25,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aedc0efeb96b28aa34bf01 HTTP/1.1" 200 None 2026-03-09 14:41:25,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:41:25,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 14:41:25,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:41:25,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aedc0efeb96b28aa34bf01 HTTP/1.1" 200 None 2026-03-09 14:41:25,235 - lava_callback - INFO - Completed processing callback for node 69aedc0efeb96b28aa34bf01 INFO: 172.20.0.1:37036 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:41:35,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:41:35,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39450 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:42:57,514 - lava_callback - INFO - Received callback for node 69ac396640deb775998f5a88 INFO: 172.20.0.1:39458 - "POST /node/69ac396640deb775998f5a88 HTTP/1.0" 202 Accepted 2026-03-09 14:42:57,519 - lava_callback - INFO - Starting async job submit for node 69ac396640deb775998f5a88 2026-03-09 14:42:57,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:42:57,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac396640deb775998f5a88 HTTP/1.1" 200 None 2026-03-09 14:42:57,536 - lava_callback - DEBUG - Processing node 69ac396640deb775998f5a88: baseline-arm-baylibre 2026-03-09 14:42:57,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac396640deb775998f5a88 2026-03-09 14:42:57,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:42:57,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac396640deb775998f5a88 HTTP/1.1" 200 None 2026-03-09 14:42:57,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:42:57,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-09 14:42:57,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:42:57,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac396640deb775998f5a88 HTTP/1.1" 200 None 2026-03-09 14:42:57,610 - lava_callback - ERROR - Error processing callback for node 69ac396640deb775998f5a88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35530 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:43:37,361 - lava_callback - INFO - Received callback for node 69ac398a40deb775998f5a97 INFO: 172.20.0.1:35546 - "POST /node/69ac398a40deb775998f5a97 HTTP/1.0" 202 Accepted 2026-03-09 14:43:37,368 - lava_callback - INFO - Starting async job submit for node 69ac398a40deb775998f5a97 2026-03-09 14:43:37,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:43:37,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac398a40deb775998f5a97 HTTP/1.1" 200 None 2026-03-09 14:43:37,384 - lava_callback - DEBUG - Processing node 69ac398a40deb775998f5a97: baseline-arm-baylibre 2026-03-09 14:43:37,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac398a40deb775998f5a97 2026-03-09 14:43:37,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:43:37,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac398a40deb775998f5a97 HTTP/1.1" 200 None 2026-03-09 14:43:37,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:43:37,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-09 14:43:37,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:43:37,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac398a40deb775998f5a97 HTTP/1.1" 200 None 2026-03-09 14:43:37,438 - lava_callback - ERROR - Error processing callback for node 69ac398a40deb775998f5a97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:45:17,782 - lava_callback - INFO - Received callback for node 69ac39eb40deb775998f5abf INFO: 172.20.0.1:37332 - "POST /node/69ac39eb40deb775998f5abf HTTP/1.0" 202 Accepted 2026-03-09 14:45:17,788 - lava_callback - INFO - Starting async job submit for node 69ac39eb40deb775998f5abf 2026-03-09 14:45:17,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:45:17,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac39eb40deb775998f5abf HTTP/1.1" 200 None 2026-03-09 14:45:17,805 - lava_callback - DEBUG - Processing node 69ac39eb40deb775998f5abf: baseline-arm-baylibre 2026-03-09 14:45:17,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac39eb40deb775998f5abf 2026-03-09 14:45:17,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:45:17,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac39eb40deb775998f5abf HTTP/1.1" 200 None 2026-03-09 14:45:17,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:45:17,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-09 14:45:17,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:45:17,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac39eb40deb775998f5abf HTTP/1.1" 200 None 2026-03-09 14:45:17,862 - lava_callback - ERROR - Error processing callback for node 69ac39eb40deb775998f5abf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56762 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:46:57,593 - lava_callback - INFO - Received callback for node 69ac3a4c40deb775998f5aed INFO: 172.20.0.1:56778 - "POST /node/69ac3a4c40deb775998f5aed HTTP/1.0" 202 Accepted 2026-03-09 14:46:57,600 - lava_callback - INFO - Starting async job submit for node 69ac3a4c40deb775998f5aed 2026-03-09 14:46:57,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:46:57,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3a4c40deb775998f5aed HTTP/1.1" 200 None 2026-03-09 14:46:57,621 - lava_callback - DEBUG - Processing node 69ac3a4c40deb775998f5aed: baseline-arm-baylibre 2026-03-09 14:46:57,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3a4c40deb775998f5aed 2026-03-09 14:46:57,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:46:57,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3a4c40deb775998f5aed HTTP/1.1" 200 None 2026-03-09 14:46:57,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:46:57,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-09 14:46:57,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:46:57,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3a4c40deb775998f5aed HTTP/1.1" 200 None 2026-03-09 14:46:57,683 - lava_callback - ERROR - Error processing callback for node 69ac3a4c40deb775998f5aed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48486 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:47:17,621 - lava_callback - INFO - Received callback for node 69ac3a7040deb775998f5afa INFO: 172.20.0.1:48502 - "POST /node/69ac3a7040deb775998f5afa HTTP/1.0" 202 Accepted 2026-03-09 14:47:17,627 - lava_callback - INFO - Starting async job submit for node 69ac3a7040deb775998f5afa 2026-03-09 14:47:17,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:17,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3a7040deb775998f5afa HTTP/1.1" 200 None 2026-03-09 14:47:17,643 - lava_callback - DEBUG - Processing node 69ac3a7040deb775998f5afa: baseline-arm-baylibre 2026-03-09 14:47:17,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3a7040deb775998f5afa 2026-03-09 14:47:17,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:17,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3a7040deb775998f5afa HTTP/1.1" 200 None 2026-03-09 14:47:17,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-09 14:47:17,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:17,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3a7040deb775998f5afa HTTP/1.1" 200 None 2026-03-09 14:47:17,707 - lava_callback - ERROR - Error processing callback for node 69ac3a7040deb775998f5afa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43832 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:47:57,596 - lava_callback - INFO - Received callback for node 69ac3a9640deb775998f5b12 INFO: 172.20.0.1:43834 - "POST /node/69ac3a9640deb775998f5b12 HTTP/1.0" 202 Accepted 2026-03-09 14:47:57,601 - lava_callback - INFO - Starting async job submit for node 69ac3a9640deb775998f5b12 2026-03-09 14:47:57,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:57,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3a9640deb775998f5b12 HTTP/1.1" 200 None 2026-03-09 14:47:57,623 - lava_callback - DEBUG - Processing node 69ac3a9640deb775998f5b12: baseline-arm-baylibre 2026-03-09 14:47:57,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3a9640deb775998f5b12 2026-03-09 14:47:57,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:57,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3a9640deb775998f5b12 HTTP/1.1" 200 None 2026-03-09 14:47:57,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:57,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-09 14:47:57,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:47:57,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3a9640deb775998f5b12 HTTP/1.1" 200 None 2026-03-09 14:47:57,681 - lava_callback - ERROR - Error processing callback for node 69ac3a9640deb775998f5b12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:49:37,740 - lava_callback - INFO - Received callback for node 69ac3afc40deb775998f5b59 INFO: 172.20.0.1:43986 - "POST /node/69ac3afc40deb775998f5b59 HTTP/1.0" 202 Accepted 2026-03-09 14:49:37,746 - lava_callback - INFO - Starting async job submit for node 69ac3afc40deb775998f5b59 2026-03-09 14:49:37,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:49:37,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3afc40deb775998f5b59 HTTP/1.1" 200 None 2026-03-09 14:49:37,761 - lava_callback - DEBUG - Processing node 69ac3afc40deb775998f5b59: baseline-arm-baylibre 2026-03-09 14:49:37,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3afc40deb775998f5b59 2026-03-09 14:49:37,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:49:37,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3afc40deb775998f5b59 HTTP/1.1" 200 None 2026-03-09 14:49:37,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:49:37,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:49:37,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:49:37,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3afc40deb775998f5b59 HTTP/1.1" 200 None 2026-03-09 14:49:37,821 - lava_callback - ERROR - Error processing callback for node 69ac3afc40deb775998f5b59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49600 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:50:17,706 - lava_callback - INFO - Received callback for node 69ac3b2040deb775998f5b65 INFO: 172.20.0.1:49612 - "POST /node/69ac3b2040deb775998f5b65 HTTP/1.0" 202 Accepted 2026-03-09 14:50:17,712 - lava_callback - INFO - Starting async job submit for node 69ac3b2040deb775998f5b65 2026-03-09 14:50:17,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:17,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b2040deb775998f5b65 HTTP/1.1" 200 None 2026-03-09 14:50:17,730 - lava_callback - DEBUG - Processing node 69ac3b2040deb775998f5b65: baseline-arm-baylibre 2026-03-09 14:50:17,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3b2040deb775998f5b65 2026-03-09 14:50:17,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:17,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b2040deb775998f5b65 HTTP/1.1" 200 None 2026-03-09 14:50:17,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:17,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:50:17,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:17,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3b2040deb775998f5b65 HTTP/1.1" 200 None 2026-03-09 14:50:17,820 - lava_callback - ERROR - Error processing callback for node 69ac3b2040deb775998f5b65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36134 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:50:57,799 - lava_callback - INFO - Received callback for node 69ac3b4340deb775998f5b76 INFO: 172.20.0.1:36148 - "POST /node/69ac3b4340deb775998f5b76 HTTP/1.0" 202 Accepted 2026-03-09 14:50:57,805 - lava_callback - INFO - Starting async job submit for node 69ac3b4340deb775998f5b76 2026-03-09 14:50:57,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:57,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b4340deb775998f5b76 HTTP/1.1" 200 None 2026-03-09 14:50:57,820 - lava_callback - DEBUG - Processing node 69ac3b4340deb775998f5b76: baseline-arm-baylibre 2026-03-09 14:50:57,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3b4340deb775998f5b76 2026-03-09 14:50:57,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:57,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b4340deb775998f5b76 HTTP/1.1" 200 None 2026-03-09 14:50:57,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:57,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:50:57,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:50:57,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3b4340deb775998f5b76 HTTP/1.1" 200 None 2026-03-09 14:50:57,912 - lava_callback - ERROR - Error processing callback for node 69ac3b4340deb775998f5b76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36474 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:51:37,783 - lava_callback - INFO - Received callback for node 69ac3b6740deb775998f5b7f INFO: 172.20.0.1:36476 - "POST /node/69ac3b6740deb775998f5b7f HTTP/1.0" 202 Accepted 2026-03-09 14:51:37,789 - lava_callback - INFO - Starting async job submit for node 69ac3b6740deb775998f5b7f 2026-03-09 14:51:37,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:37,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b6740deb775998f5b7f HTTP/1.1" 200 None 2026-03-09 14:51:37,805 - lava_callback - DEBUG - Processing node 69ac3b6740deb775998f5b7f: baseline-arm-baylibre 2026-03-09 14:51:37,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3b6740deb775998f5b7f 2026-03-09 14:51:37,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:37,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b6740deb775998f5b7f HTTP/1.1" 200 None 2026-03-09 14:51:37,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:37,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:51:37,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:37,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3b6740deb775998f5b7f HTTP/1.1" 200 None 2026-03-09 14:51:37,863 - lava_callback - ERROR - Error processing callback for node 69ac3b6740deb775998f5b7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:51:57,807 - lava_callback - INFO - Received callback for node 69ac3b8b40deb775998f5b89 INFO: 172.20.0.1:47410 - "POST /node/69ac3b8b40deb775998f5b89 HTTP/1.0" 202 Accepted 2026-03-09 14:51:57,812 - lava_callback - INFO - Starting async job submit for node 69ac3b8b40deb775998f5b89 2026-03-09 14:51:57,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:57,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b8b40deb775998f5b89 HTTP/1.1" 200 None 2026-03-09 14:51:57,828 - lava_callback - DEBUG - Processing node 69ac3b8b40deb775998f5b89: baseline-arm-baylibre 2026-03-09 14:51:57,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3b8b40deb775998f5b89 2026-03-09 14:51:57,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:57,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3b8b40deb775998f5b89 HTTP/1.1" 200 None 2026-03-09 14:51:57,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:57,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:51:57,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:51:57,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3b8b40deb775998f5b89 HTTP/1.1" 200 None 2026-03-09 14:51:57,916 - lava_callback - ERROR - Error processing callback for node 69ac3b8b40deb775998f5b89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57644 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:52:37,846 - lava_callback - INFO - Received callback for node 69ac3baf40deb775998f5b98 INFO: 172.20.0.1:57646 - "POST /node/69ac3baf40deb775998f5b98 HTTP/1.0" 202 Accepted 2026-03-09 14:52:37,852 - lava_callback - INFO - Starting async job submit for node 69ac3baf40deb775998f5b98 2026-03-09 14:52:37,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:52:37,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3baf40deb775998f5b98 HTTP/1.1" 200 None 2026-03-09 14:52:37,869 - lava_callback - DEBUG - Processing node 69ac3baf40deb775998f5b98: baseline-arm-baylibre 2026-03-09 14:52:37,869 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3baf40deb775998f5b98 2026-03-09 14:52:37,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:52:37,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3baf40deb775998f5b98 HTTP/1.1" 200 None 2026-03-09 14:52:37,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:52:37,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:52:37,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:52:37,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3baf40deb775998f5b98 HTTP/1.1" 200 None 2026-03-09 14:52:37,929 - lava_callback - ERROR - Error processing callback for node 69ac3baf40deb775998f5b98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52906 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:54:32,616 - lava_callback - INFO - Received callback for node 69ac3c1940deb775998f5bbc INFO: 172.20.0.1:49758 - "POST /node/69ac3c1940deb775998f5bbc HTTP/1.0" 202 Accepted 2026-03-09 14:54:32,621 - lava_callback - INFO - Starting async job submit for node 69ac3c1940deb775998f5bbc 2026-03-09 14:54:32,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:54:32,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c1940deb775998f5bbc HTTP/1.1" 200 None 2026-03-09 14:54:32,637 - lava_callback - DEBUG - Processing node 69ac3c1940deb775998f5bbc: baseline-arm-clabbe 2026-03-09 14:54:32,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3c1940deb775998f5bbc 2026-03-09 14:54:32,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:54:32,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c1940deb775998f5bbc HTTP/1.1" 200 None 2026-03-09 14:54:32,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:54:32,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:54:32,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:54:32,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3c1940deb775998f5bbc HTTP/1.1" 200 None 2026-03-09 14:54:32,708 - lava_callback - ERROR - Error processing callback for node 69ac3c1940deb775998f5bbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41676 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:55:12,497 - lava_callback - INFO - Received callback for node 69ac3c3e40deb775998f5bcc INFO: 172.20.0.1:46856 - "POST /node/69ac3c3e40deb775998f5bcc HTTP/1.0" 202 Accepted 2026-03-09 14:55:12,504 - lava_callback - INFO - Starting async job submit for node 69ac3c3e40deb775998f5bcc 2026-03-09 14:55:12,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:12,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c3e40deb775998f5bcc HTTP/1.1" 200 None 2026-03-09 14:55:12,541 - lava_callback - DEBUG - Processing node 69ac3c3e40deb775998f5bcc: baseline-arm-clabbe 2026-03-09 14:55:12,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3c3e40deb775998f5bcc 2026-03-09 14:55:12,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:12,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c3e40deb775998f5bcc HTTP/1.1" 200 None 2026-03-09 14:55:12,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:12,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:55:12,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:12,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3c3e40deb775998f5bcc HTTP/1.1" 200 None 2026-03-09 14:55:12,606 - lava_callback - ERROR - Error processing callback for node 69ac3c3e40deb775998f5bcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46820 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:55:52,613 - lava_callback - INFO - Received callback for node 69ac3c6240deb775998f5bdd INFO: 172.20.0.1:35326 - "POST /node/69ac3c6240deb775998f5bdd HTTP/1.0" 202 Accepted 2026-03-09 14:55:52,618 - lava_callback - INFO - Starting async job submit for node 69ac3c6240deb775998f5bdd 2026-03-09 14:55:52,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:52,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c6240deb775998f5bdd HTTP/1.1" 200 None 2026-03-09 14:55:52,634 - lava_callback - DEBUG - Processing node 69ac3c6240deb775998f5bdd: baseline-arm-clabbe 2026-03-09 14:55:52,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3c6240deb775998f5bdd 2026-03-09 14:55:52,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:52,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c6240deb775998f5bdd HTTP/1.1" 200 None 2026-03-09 14:55:52,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:52,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-09 14:55:52,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:55:52,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3c6240deb775998f5bdd HTTP/1.1" 200 None 2026-03-09 14:55:52,689 - lava_callback - ERROR - Error processing callback for node 69ac3c6240deb775998f5bdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55956 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:56:18,070 - lava_callback - INFO - Received callback for node 69ac3c8140deb775998f5bf2 INFO: 172.20.0.1:55960 - "POST /node/69ac3c8140deb775998f5bf2 HTTP/1.0" 202 Accepted 2026-03-09 14:56:18,076 - lava_callback - INFO - Starting async job submit for node 69ac3c8140deb775998f5bf2 2026-03-09 14:56:18,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:18,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c8140deb775998f5bf2 HTTP/1.1" 200 None 2026-03-09 14:56:18,105 - lava_callback - DEBUG - Processing node 69ac3c8140deb775998f5bf2: baseline-arm-baylibre 2026-03-09 14:56:18,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3c8140deb775998f5bf2 2026-03-09 14:56:18,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:18,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3c8140deb775998f5bf2 HTTP/1.1" 200 None 2026-03-09 14:56:18,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:18,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 14:56:18,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:18,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3c8140deb775998f5bf2 HTTP/1.1" 200 None 2026-03-09 14:56:18,161 - lava_callback - ERROR - Error processing callback for node 69ac3c8140deb775998f5bf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33240 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:56:58,042 - lava_callback - INFO - Received callback for node 69ac3ca540deb775998f5c0a INFO: 172.20.0.1:33254 - "POST /node/69ac3ca540deb775998f5c0a HTTP/1.0" 202 Accepted 2026-03-09 14:56:58,047 - lava_callback - INFO - Starting async job submit for node 69ac3ca540deb775998f5c0a 2026-03-09 14:56:58,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:58,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3ca540deb775998f5c0a HTTP/1.1" 200 None 2026-03-09 14:56:58,064 - lava_callback - DEBUG - Processing node 69ac3ca540deb775998f5c0a: baseline-arm-baylibre 2026-03-09 14:56:58,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3ca540deb775998f5c0a 2026-03-09 14:56:58,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:58,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3ca540deb775998f5c0a HTTP/1.1" 200 None 2026-03-09 14:56:58,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:58,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 14:56:58,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:56:58,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3ca540deb775998f5c0a HTTP/1.1" 200 None 2026-03-09 14:56:58,143 - lava_callback - ERROR - Error processing callback for node 69ac3ca540deb775998f5c0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54564 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:57:18,076 - lava_callback - INFO - Received callback for node 69ac3cc840deb775998f5c1c INFO: 172.20.0.1:54574 - "POST /node/69ac3cc840deb775998f5c1c HTTP/1.0" 202 Accepted 2026-03-09 14:57:18,082 - lava_callback - INFO - Starting async job submit for node 69ac3cc840deb775998f5c1c 2026-03-09 14:57:18,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:18,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3cc840deb775998f5c1c HTTP/1.1" 200 None 2026-03-09 14:57:18,099 - lava_callback - DEBUG - Processing node 69ac3cc840deb775998f5c1c: baseline-arm-baylibre 2026-03-09 14:57:18,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3cc840deb775998f5c1c 2026-03-09 14:57:18,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:18,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3cc840deb775998f5c1c HTTP/1.1" 200 None 2026-03-09 14:57:18,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:18,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 14:57:18,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:18,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3cc840deb775998f5c1c HTTP/1.1" 200 None 2026-03-09 14:57:18,160 - lava_callback - ERROR - Error processing callback for node 69ac3cc840deb775998f5c1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59592 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:57:58,178 - lava_callback - INFO - Received callback for node 69ac3cee40deb775998f5c32 INFO: 172.20.0.1:59602 - "POST /node/69ac3cee40deb775998f5c32 HTTP/1.0" 202 Accepted 2026-03-09 14:57:58,183 - lava_callback - INFO - Starting async job submit for node 69ac3cee40deb775998f5c32 2026-03-09 14:57:58,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:58,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3cee40deb775998f5c32 HTTP/1.1" 200 None 2026-03-09 14:57:58,200 - lava_callback - DEBUG - Processing node 69ac3cee40deb775998f5c32: baseline-arm-baylibre 2026-03-09 14:57:58,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3cee40deb775998f5c32 2026-03-09 14:57:58,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:58,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3cee40deb775998f5c32 HTTP/1.1" 200 None 2026-03-09 14:57:58,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:58,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 14:57:58,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:57:58,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3cee40deb775998f5c32 HTTP/1.1" 200 None 2026-03-09 14:57:58,282 - lava_callback - ERROR - Error processing callback for node 69ac3cee40deb775998f5c32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52866 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:58:38,134 - lava_callback - INFO - Received callback for node 69ac3d1040deb775998f5c3e INFO: 172.20.0.1:52882 - "POST /node/69ac3d1040deb775998f5c3e HTTP/1.0" 202 Accepted 2026-03-09 14:58:38,139 - lava_callback - INFO - Starting async job submit for node 69ac3d1040deb775998f5c3e 2026-03-09 14:58:38,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:58:38,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d1040deb775998f5c3e HTTP/1.1" 200 None 2026-03-09 14:58:38,164 - lava_callback - DEBUG - Processing node 69ac3d1040deb775998f5c3e: baseline-arm-baylibre 2026-03-09 14:58:38,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3d1040deb775998f5c3e 2026-03-09 14:58:38,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:58:38,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d1040deb775998f5c3e HTTP/1.1" 200 None 2026-03-09 14:58:38,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:58:38,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 14:58:38,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:58:38,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3d1040deb775998f5c3e HTTP/1.1" 200 None 2026-03-09 14:58:38,218 - lava_callback - ERROR - Error processing callback for node 69ac3d1040deb775998f5c3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:59:18,225 - lava_callback - INFO - Received callback for node 69ac3d3440deb775998f5c56 INFO: 172.20.0.1:47288 - "POST /node/69ac3d3440deb775998f5c56 HTTP/1.0" 202 Accepted 2026-03-09 14:59:18,231 - lava_callback - INFO - Starting async job submit for node 69ac3d3440deb775998f5c56 2026-03-09 14:59:18,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:18,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d3440deb775998f5c56 HTTP/1.1" 200 None 2026-03-09 14:59:18,251 - lava_callback - DEBUG - Processing node 69ac3d3440deb775998f5c56: baseline-arm-baylibre 2026-03-09 14:59:18,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3d3440deb775998f5c56 2026-03-09 14:59:18,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:18,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d3440deb775998f5c56 HTTP/1.1" 200 None 2026-03-09 14:59:18,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:18,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 14:59:18,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:18,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3d3440deb775998f5c56 HTTP/1.1" 200 None 2026-03-09 14:59:18,329 - lava_callback - ERROR - Error processing callback for node 69ac3d3440deb775998f5c56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55068 - "GET / HTTP/1.0" 200 OK 2026-03-09 14:59:58,249 - lava_callback - INFO - Received callback for node 69ac3d5940deb775998f5c67 INFO: 172.20.0.1:55072 - "POST /node/69ac3d5940deb775998f5c67 HTTP/1.0" 202 Accepted 2026-03-09 14:59:58,254 - lava_callback - INFO - Starting async job submit for node 69ac3d5940deb775998f5c67 2026-03-09 14:59:58,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:58,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d5940deb775998f5c67 HTTP/1.1" 200 None 2026-03-09 14:59:58,280 - lava_callback - DEBUG - Processing node 69ac3d5940deb775998f5c67: baseline-arm-baylibre 2026-03-09 14:59:58,280 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3d5940deb775998f5c67 2026-03-09 14:59:58,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:58,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d5940deb775998f5c67 HTTP/1.1" 200 None 2026-03-09 14:59:58,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:58,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 14:59:58,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 14:59:58,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3d5940deb775998f5c67 HTTP/1.1" 200 None 2026-03-09 14:59:58,336 - lava_callback - ERROR - Error processing callback for node 69ac3d5940deb775998f5c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40478 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:00:18,254 - lava_callback - INFO - Received callback for node 69ac3d7a40deb775998f5c75 INFO: 172.20.0.1:40480 - "POST /node/69ac3d7a40deb775998f5c75 HTTP/1.0" 202 Accepted 2026-03-09 15:00:18,259 - lava_callback - INFO - Starting async job submit for node 69ac3d7a40deb775998f5c75 2026-03-09 15:00:18,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:18,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d7a40deb775998f5c75 HTTP/1.1" 200 None 2026-03-09 15:00:18,276 - lava_callback - DEBUG - Processing node 69ac3d7a40deb775998f5c75: baseline-arm-baylibre 2026-03-09 15:00:18,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3d7a40deb775998f5c75 2026-03-09 15:00:18,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:18,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d7a40deb775998f5c75 HTTP/1.1" 200 None 2026-03-09 15:00:18,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:18,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:00:18,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:18,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3d7a40deb775998f5c75 HTTP/1.1" 200 None 2026-03-09 15:00:18,335 - lava_callback - ERROR - Error processing callback for node 69ac3d7a40deb775998f5c75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47682 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:00:58,310 - lava_callback - INFO - Received callback for node 69ac3d9e40deb775998f5c84 INFO: 172.20.0.1:47684 - "POST /node/69ac3d9e40deb775998f5c84 HTTP/1.0" 202 Accepted 2026-03-09 15:00:58,315 - lava_callback - INFO - Starting async job submit for node 69ac3d9e40deb775998f5c84 2026-03-09 15:00:58,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:58,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d9e40deb775998f5c84 HTTP/1.1" 200 None 2026-03-09 15:00:58,332 - lava_callback - DEBUG - Processing node 69ac3d9e40deb775998f5c84: baseline-arm-baylibre 2026-03-09 15:00:58,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3d9e40deb775998f5c84 2026-03-09 15:00:58,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:58,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3d9e40deb775998f5c84 HTTP/1.1" 200 None 2026-03-09 15:00:58,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:58,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:00:58,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:00:58,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3d9e40deb775998f5c84 HTTP/1.1" 200 None 2026-03-09 15:00:58,391 - lava_callback - ERROR - Error processing callback for node 69ac3d9e40deb775998f5c84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35484 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:01:29,117 - lava_callback - INFO - Received callback for node 69aed822feb96b28aa34be61 INFO: 172.20.0.1:35498 - "POST /node/69aed822feb96b28aa34be61 HTTP/1.0" 202 Accepted 2026-03-09 15:01:29,123 - lava_callback - INFO - Starting async job submit for node 69aed822feb96b28aa34be61 2026-03-09 15:01:29,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:29,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed822feb96b28aa34be61 HTTP/1.1" 200 None 2026-03-09 15:01:29,162 - lava_callback - DEBUG - Processing node 69aed822feb96b28aa34be61: baseline-arm64 2026-03-09 15:01:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:01:29,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:01:29,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed822feb96b28aa34be61/log.txt.gz 2026-03-09 15:01:30,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:01:30,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:01:30,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed822feb96b28aa34be61/lava-logs.yaml 2026-03-09 15:01:30,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:01:30,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:01:30,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aed822feb96b28aa34be61/lava_callback.json.gz 2026-03-09 15:01:30,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:30,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed822feb96b28aa34be61 HTTP/1.1" 200 None 2026-03-09 15:01:30,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:30,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:01:30,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:30,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed822feb96b28aa34be61 HTTP/1.1" 200 None 2026-03-09 15:01:30,644 - lava_callback - INFO - Completed processing callback for node 69aed822feb96b28aa34be61 2026-03-09 15:01:35,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:35,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:01:38,424 - lava_callback - INFO - Received callback for node 69ac3dc340deb775998f5c9c INFO: 172.20.0.1:35634 - "POST /node/69ac3dc340deb775998f5c9c HTTP/1.0" 202 Accepted 2026-03-09 15:01:38,429 - lava_callback - INFO - Starting async job submit for node 69ac3dc340deb775998f5c9c 2026-03-09 15:01:38,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:38,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3dc340deb775998f5c9c HTTP/1.1" 200 None 2026-03-09 15:01:38,445 - lava_callback - DEBUG - Processing node 69ac3dc340deb775998f5c9c: baseline-arm-baylibre 2026-03-09 15:01:38,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3dc340deb775998f5c9c 2026-03-09 15:01:38,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:38,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3dc340deb775998f5c9c HTTP/1.1" 200 None 2026-03-09 15:01:38,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:38,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:01:38,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:01:38,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3dc340deb775998f5c9c HTTP/1.1" 200 None 2026-03-09 15:01:38,506 - lava_callback - ERROR - Error processing callback for node 69ac3dc340deb775998f5c9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48694 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:02:18,370 - lava_callback - INFO - Received callback for node 69ac3de540deb775998f5cae INFO: 172.20.0.1:48696 - "POST /node/69ac3de540deb775998f5cae HTTP/1.0" 202 Accepted 2026-03-09 15:02:18,375 - lava_callback - INFO - Starting async job submit for node 69ac3de540deb775998f5cae 2026-03-09 15:02:18,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:18,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3de540deb775998f5cae HTTP/1.1" 200 None 2026-03-09 15:02:18,391 - lava_callback - DEBUG - Processing node 69ac3de540deb775998f5cae: baseline-arm-baylibre 2026-03-09 15:02:18,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3de540deb775998f5cae 2026-03-09 15:02:18,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:18,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3de540deb775998f5cae HTTP/1.1" 200 None 2026-03-09 15:02:18,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:18,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:02:18,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:18,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3de540deb775998f5cae HTTP/1.1" 200 None 2026-03-09 15:02:18,443 - lava_callback - ERROR - Error processing callback for node 69ac3de540deb775998f5cae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48308 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:02:40,111 - lava_callback - INFO - Received callback for node 69aee0b1feb96b28aa34c094 INFO: 172.20.0.1:45252 - "POST /node/69aee0b1feb96b28aa34c094 HTTP/1.0" 202 Accepted 2026-03-09 15:02:40,118 - lava_callback - INFO - Starting async job submit for node 69aee0b1feb96b28aa34c094 2026-03-09 15:02:40,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:40,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee0b1feb96b28aa34c094 HTTP/1.1" 200 None 2026-03-09 15:02:40,149 - lava_callback - DEBUG - Processing node 69aee0b1feb96b28aa34c094: baseline-arm64 2026-03-09 15:02:40,197 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:02:40,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:02:40,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:02:40,405 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee0b1feb96b28aa34c094/lava-logs.yaml 2026-03-09 15:02:40,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:02:40,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:02:40,569 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee0b1feb96b28aa34c094/lava_callback.json.gz 2026-03-09 15:02:40,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:40,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee0b1feb96b28aa34c094 HTTP/1.1" 200 None 2026-03-09 15:02:40,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:40,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:02:40,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:40,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee0b1feb96b28aa34c094 HTTP/1.1" 200 None 2026-03-09 15:02:40,693 - lava_callback - INFO - Completed processing callback for node 69aee0b1feb96b28aa34c094 INFO: 172.20.0.1:45264 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:02:51,964 - lava_callback - INFO - Received callback for node 69aed8c2feb96b28aa34be75 INFO: 172.20.0.1:45660 - "POST /node/69aed8c2feb96b28aa34be75 HTTP/1.0" 202 Accepted 2026-03-09 15:02:51,972 - lava_callback - INFO - Starting async job submit for node 69aed8c2feb96b28aa34be75 2026-03-09 15:02:51,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:52,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed8c2feb96b28aa34be75 HTTP/1.1" 200 None 2026-03-09 15:02:52,019 - lava_callback - DEBUG - Processing node 69aed8c2feb96b28aa34be75: baseline-nfs-arm64 2026-03-09 15:02:52,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:02:52,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:02:52,633 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed8c2feb96b28aa34be75/log.txt.gz 2026-03-09 15:02:52,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:02:52,929 - lava_callback - INFO - Received callback for node 69ac3e0b40deb775998f5cca INFO: 172.20.0.1:45676 - "POST /node/69ac3e0b40deb775998f5cca HTTP/1.0" 202 Accepted 2026-03-09 15:02:52,938 - lava_callback - INFO - Starting async job submit for node 69ac3e0b40deb775998f5cca 2026-03-09 15:02:52,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:52,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3e0b40deb775998f5cca HTTP/1.1" 200 None 2026-03-09 15:02:52,954 - lava_callback - DEBUG - Processing node 69ac3e0b40deb775998f5cca: baseline-arm-clabbe 2026-03-09 15:02:52,954 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3e0b40deb775998f5cca 2026-03-09 15:02:52,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:52,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3e0b40deb775998f5cca HTTP/1.1" 200 None 2026-03-09 15:02:52,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:52,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:02:52,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:53,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3e0b40deb775998f5cca HTTP/1.1" 200 None 2026-03-09 15:02:53,007 - lava_callback - ERROR - Error processing callback for node 69ac3e0b40deb775998f5cca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 15:02:53,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:02:53,190 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed8c2feb96b28aa34be75/lava-logs.yaml 2026-03-09 15:02:53,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:02:53,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:02:53,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aed8c2feb96b28aa34be75/lava_callback.json.gz 2026-03-09 15:02:53,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:53,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aed8c2feb96b28aa34be75 HTTP/1.1" 200 None 2026-03-09 15:02:53,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:53,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:02:53,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:02:53,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aed8c2feb96b28aa34be75 HTTP/1.1" 200 None 2026-03-09 15:02:53,509 - lava_callback - INFO - Completed processing callback for node 69aed8c2feb96b28aa34be75 INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45692 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:03:05,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:05,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47202 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:03:32,925 - lava_callback - INFO - Received callback for node 69ac3e2f40deb775998f5ce4 INFO: 172.20.0.1:41232 - "POST /node/69ac3e2f40deb775998f5ce4 HTTP/1.0" 202 Accepted 2026-03-09 15:03:32,931 - lava_callback - INFO - Starting async job submit for node 69ac3e2f40deb775998f5ce4 2026-03-09 15:03:32,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:32,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3e2f40deb775998f5ce4 HTTP/1.1" 200 None 2026-03-09 15:03:32,948 - lava_callback - DEBUG - Processing node 69ac3e2f40deb775998f5ce4: baseline-arm-clabbe 2026-03-09 15:03:32,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3e2f40deb775998f5ce4 2026-03-09 15:03:32,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:32,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3e2f40deb775998f5ce4 HTTP/1.1" 200 None 2026-03-09 15:03:32,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:32,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:03:32,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:33,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3e2f40deb775998f5ce4 HTTP/1.1" 200 None 2026-03-09 15:03:33,015 - lava_callback - ERROR - Error processing callback for node 69ac3e2f40deb775998f5ce4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40864 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:03:58,491 - lava_callback - INFO - Received callback for node 69ac3e5040deb775998f5d0f INFO: 172.20.0.1:40872 - "POST /node/69ac3e5040deb775998f5d0f HTTP/1.0" 202 Accepted 2026-03-09 15:03:58,497 - lava_callback - INFO - Starting async job submit for node 69ac3e5040deb775998f5d0f 2026-03-09 15:03:58,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:58,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3e5040deb775998f5d0f HTTP/1.1" 200 None 2026-03-09 15:03:58,516 - lava_callback - DEBUG - Processing node 69ac3e5040deb775998f5d0f: baseline-arm-baylibre 2026-03-09 15:03:58,517 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3e5040deb775998f5d0f 2026-03-09 15:03:58,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:58,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3e5040deb775998f5d0f HTTP/1.1" 200 None 2026-03-09 15:03:58,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:58,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:03:58,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:03:58,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3e5040deb775998f5d0f HTTP/1.1" 200 None 2026-03-09 15:03:58,589 - lava_callback - ERROR - Error processing callback for node 69ac3e5040deb775998f5d0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38532 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:05:53,094 - lava_callback - INFO - Received callback for node 69ac3ebf40deb775998f5d3f INFO: 172.20.0.1:45034 - "POST /node/69ac3ebf40deb775998f5d3f HTTP/1.0" 202 Accepted 2026-03-09 15:05:53,100 - lava_callback - INFO - Starting async job submit for node 69ac3ebf40deb775998f5d3f 2026-03-09 15:05:53,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:05:53,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3ebf40deb775998f5d3f HTTP/1.1" 200 None 2026-03-09 15:05:53,117 - lava_callback - DEBUG - Processing node 69ac3ebf40deb775998f5d3f: baseline-arm-clabbe 2026-03-09 15:05:53,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3ebf40deb775998f5d3f 2026-03-09 15:05:53,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:05:53,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3ebf40deb775998f5d3f HTTP/1.1" 200 None 2026-03-09 15:05:53,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:05:53,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:05:53,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:05:53,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3ebf40deb775998f5d3f HTTP/1.1" 200 None 2026-03-09 15:05:53,175 - lava_callback - ERROR - Error processing callback for node 69ac3ebf40deb775998f5d3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42406 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:06:13,476 - lava_callback - INFO - Received callback for node 69aee1d1feb96b28aa34c10e INFO: 172.20.0.1:48244 - "POST /node/69aee1d1feb96b28aa34c10e HTTP/1.0" 202 Accepted 2026-03-09 15:06:13,482 - lava_callback - INFO - Starting async job submit for node 69aee1d1feb96b28aa34c10e 2026-03-09 15:06:13,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:13,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee1d1feb96b28aa34c10e HTTP/1.1" 200 None 2026-03-09 15:06:13,499 - lava_callback - DEBUG - Processing node 69aee1d1feb96b28aa34c10e: baseline-nfs-arm64 2026-03-09 15:06:13,500 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:06:13,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:06:13,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:06:13,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aee1d1feb96b28aa34c10e/lava-logs.yaml 2026-03-09 15:06:13,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:06:13,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:06:13,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aee1d1feb96b28aa34c10e/lava_callback.json.gz 2026-03-09 15:06:13,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:13,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee1d1feb96b28aa34c10e HTTP/1.1" 200 None 2026-03-09 15:06:13,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:13,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:06:13,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:13,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee1d1feb96b28aa34c10e HTTP/1.1" 200 None 2026-03-09 15:06:13,860 - lava_callback - INFO - Completed processing callback for node 69aee1d1feb96b28aa34c10e INFO: 172.20.0.1:48248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56560 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:06:33,050 - lava_callback - INFO - Received callback for node 69ac3ee240deb775998f5d4d INFO: 172.20.0.1:33862 - "POST /node/69ac3ee240deb775998f5d4d HTTP/1.0" 202 Accepted 2026-03-09 15:06:33,056 - lava_callback - INFO - Starting async job submit for node 69ac3ee240deb775998f5d4d 2026-03-09 15:06:33,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:33,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3ee240deb775998f5d4d HTTP/1.1" 200 None 2026-03-09 15:06:33,087 - lava_callback - DEBUG - Processing node 69ac3ee240deb775998f5d4d: baseline-arm-clabbe 2026-03-09 15:06:33,087 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac3ee240deb775998f5d4d 2026-03-09 15:06:33,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:33,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac3ee240deb775998f5d4d HTTP/1.1" 200 None 2026-03-09 15:06:33,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:33,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-09 15:06:33,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:33,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac3ee240deb775998f5d4d HTTP/1.1" 200 None 2026-03-09 15:06:33,154 - lava_callback - ERROR - Error processing callback for node 69ac3ee240deb775998f5d4d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 15:06:35,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:06:35,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56842 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:11:00,595 - lava_callback - INFO - Received callback for node 69aee2dbfeb96b28aa34c1b0 INFO: 172.20.0.1:39272 - "POST /node/69aee2dbfeb96b28aa34c1b0 HTTP/1.0" 202 Accepted 2026-03-09 15:11:00,601 - lava_callback - INFO - Starting async job submit for node 69aee2dbfeb96b28aa34c1b0 2026-03-09 15:11:00,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:11:00,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee2dbfeb96b28aa34c1b0 HTTP/1.1" 200 None 2026-03-09 15:11:00,634 - lava_callback - DEBUG - Processing node 69aee2dbfeb96b28aa34c1b0: baseline-arm64 2026-03-09 15:11:00,682 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:11:00,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:11:00,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:11:00,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee2dbfeb96b28aa34c1b0/lava-logs.yaml 2026-03-09 15:11:00,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:11:01,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:11:01,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee2dbfeb96b28aa34c1b0/lava_callback.json.gz 2026-03-09 15:11:01,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:11:01,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee2dbfeb96b28aa34c1b0 HTTP/1.1" 200 None 2026-03-09 15:11:01,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:11:01,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:11:01,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:11:01,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee2dbfeb96b28aa34c1b0 HTTP/1.1" 200 None 2026-03-09 15:11:01,172 - lava_callback - INFO - Completed processing callback for node 69aee2dbfeb96b28aa34c1b0 2026-03-09 15:11:05,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:11:05,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55000 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:12:59,020 - lava_callback - INFO - Received callback for node 69ac407640deb775998f5deb INFO: 172.20.0.1:55008 - "POST /node/69ac407640deb775998f5deb HTTP/1.0" 202 Accepted 2026-03-09 15:12:59,025 - lava_callback - INFO - Starting async job submit for node 69ac407640deb775998f5deb 2026-03-09 15:12:59,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:12:59,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac407640deb775998f5deb HTTP/1.1" 200 None 2026-03-09 15:12:59,042 - lava_callback - DEBUG - Processing node 69ac407640deb775998f5deb: baseline-arm64-baylibre 2026-03-09 15:12:59,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac407640deb775998f5deb 2026-03-09 15:12:59,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:12:59,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac407640deb775998f5deb HTTP/1.1" 200 None 2026-03-09 15:12:59,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:12:59,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:12:59,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:12:59,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac407640deb775998f5deb HTTP/1.1" 200 None 2026-03-09 15:12:59,097 - lava_callback - ERROR - Error processing callback for node 69ac407640deb775998f5deb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41598 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:14:06,391 - lava_callback - INFO - Received callback for node 69aee39ffeb96b28aa34c206 INFO: 172.20.0.1:36600 - "POST /node/69aee39ffeb96b28aa34c206 HTTP/1.0" 202 Accepted 2026-03-09 15:14:06,396 - lava_callback - INFO - Starting async job submit for node 69aee39ffeb96b28aa34c206 2026-03-09 15:14:06,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:06,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee39ffeb96b28aa34c206 HTTP/1.1" 200 None 2026-03-09 15:14:06,418 - lava_callback - DEBUG - Processing node 69aee39ffeb96b28aa34c206: baseline-arm64 2026-03-09 15:14:06,423 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:14:06,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:14:09,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:14:09,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee39ffeb96b28aa34c206/lava-logs.yaml 2026-03-09 15:14:09,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:14:10,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:14:10,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee39ffeb96b28aa34c206/lava_callback.json.gz 2026-03-09 15:14:10,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:10,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee39ffeb96b28aa34c206 HTTP/1.1" 200 None 2026-03-09 15:14:10,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:10,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:14:10,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:10,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee39ffeb96b28aa34c206 HTTP/1.1" 200 None 2026-03-09 15:14:10,072 - lava_callback - INFO - Completed processing callback for node 69aee39ffeb96b28aa34c206 INFO: 172.20.0.1:42916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42930 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:14:19,098 - lava_callback - INFO - Received callback for node 69ac40bf40deb775998f5e06 INFO: 172.20.0.1:42938 - "POST /node/69ac40bf40deb775998f5e06 HTTP/1.0" 202 Accepted 2026-03-09 15:14:19,103 - lava_callback - INFO - Starting async job submit for node 69ac40bf40deb775998f5e06 2026-03-09 15:14:19,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:19,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac40bf40deb775998f5e06 HTTP/1.1" 200 None 2026-03-09 15:14:19,120 - lava_callback - DEBUG - Processing node 69ac40bf40deb775998f5e06: baseline-arm64-baylibre 2026-03-09 15:14:19,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac40bf40deb775998f5e06 2026-03-09 15:14:19,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:19,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac40bf40deb775998f5e06 HTTP/1.1" 200 None 2026-03-09 15:14:19,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:19,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:14:19,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:19,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac40bf40deb775998f5e06 HTTP/1.1" 200 None 2026-03-09 15:14:19,182 - lava_callback - ERROR - Error processing callback for node 69ac40bf40deb775998f5e06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36664 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:14:35,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:14:35,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40982 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44102 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:15:39,100 - lava_callback - INFO - Received callback for node 69ac410940deb775998f5e1b INFO: 172.20.0.1:44106 - "POST /node/69ac410940deb775998f5e1b HTTP/1.0" 202 Accepted 2026-03-09 15:15:39,106 - lava_callback - INFO - Starting async job submit for node 69ac410940deb775998f5e1b 2026-03-09 15:15:39,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:15:39,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac410940deb775998f5e1b HTTP/1.1" 200 None 2026-03-09 15:15:39,126 - lava_callback - DEBUG - Processing node 69ac410940deb775998f5e1b: baseline-arm64-baylibre 2026-03-09 15:15:39,127 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac410940deb775998f5e1b 2026-03-09 15:15:39,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:15:39,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac410940deb775998f5e1b HTTP/1.1" 200 None 2026-03-09 15:15:39,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:15:39,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:15:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:15:39,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac410940deb775998f5e1b HTTP/1.1" 200 None 2026-03-09 15:15:39,185 - lava_callback - ERROR - Error processing callback for node 69ac410940deb775998f5e1b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49332 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:16:39,125 - lava_callback - INFO - Received callback for node 69ac415440deb775998f5e36 INFO: 172.20.0.1:49334 - "POST /node/69ac415440deb775998f5e36 HTTP/1.0" 202 Accepted 2026-03-09 15:16:39,131 - lava_callback - INFO - Starting async job submit for node 69ac415440deb775998f5e36 2026-03-09 15:16:39,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:39,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac415440deb775998f5e36 HTTP/1.1" 200 None 2026-03-09 15:16:39,147 - lava_callback - DEBUG - Processing node 69ac415440deb775998f5e36: baseline-arm64-baylibre 2026-03-09 15:16:39,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac415440deb775998f5e36 2026-03-09 15:16:39,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:39,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac415440deb775998f5e36 HTTP/1.1" 200 None 2026-03-09 15:16:39,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:39,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:16:39,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:39,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac415440deb775998f5e36 HTTP/1.1" 200 None 2026-03-09 15:16:39,204 - lava_callback - ERROR - Error processing callback for node 69ac415440deb775998f5e36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36694 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:16:48,671 - lava_callback - INFO - Received callback for node 69aee444feb96b28aa34c224 INFO: 172.20.0.1:36700 - "POST /node/69aee444feb96b28aa34c224 HTTP/1.0" 202 Accepted 2026-03-09 15:16:48,677 - lava_callback - INFO - Starting async job submit for node 69aee444feb96b28aa34c224 2026-03-09 15:16:48,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:48,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee444feb96b28aa34c224 HTTP/1.1" 200 None 2026-03-09 15:16:48,697 - lava_callback - DEBUG - Processing node 69aee444feb96b28aa34c224: baseline-nfs-arm64 2026-03-09 15:16:48,703 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:16:48,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:16:48,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:16:48,884 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aee444feb96b28aa34c224/lava-logs.yaml 2026-03-09 15:16:48,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:16:49,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:16:49,025 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aee444feb96b28aa34c224/lava_callback.json.gz 2026-03-09 15:16:49,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:49,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee444feb96b28aa34c224 HTTP/1.1" 200 None 2026-03-09 15:16:49,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:49,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:16:49,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:16:49,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee444feb96b28aa34c224 HTTP/1.1" 200 None 2026-03-09 15:16:49,091 - lava_callback - INFO - Completed processing callback for node 69aee444feb96b28aa34c224 INFO: 172.20.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:17:05,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:17:05,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36786 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:17:59,249 - lava_callback - INFO - Received callback for node 69ac41a440deb775998f5e4e INFO: 172.20.0.1:36798 - "POST /node/69ac41a440deb775998f5e4e HTTP/1.0" 202 Accepted 2026-03-09 15:17:59,255 - lava_callback - INFO - Starting async job submit for node 69ac41a440deb775998f5e4e 2026-03-09 15:17:59,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:17:59,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac41a440deb775998f5e4e HTTP/1.1" 200 None 2026-03-09 15:17:59,277 - lava_callback - DEBUG - Processing node 69ac41a440deb775998f5e4e: baseline-arm64-baylibre 2026-03-09 15:17:59,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac41a440deb775998f5e4e 2026-03-09 15:17:59,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:17:59,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac41a440deb775998f5e4e HTTP/1.1" 200 None 2026-03-09 15:17:59,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:17:59,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:17:59,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:17:59,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac41a440deb775998f5e4e HTTP/1.1" 200 None 2026-03-09 15:17:59,338 - lava_callback - ERROR - Error processing callback for node 69ac41a440deb775998f5e4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:19:19,394 - lava_callback - INFO - Received callback for node 69ac41ef40deb775998f5e6e INFO: 172.20.0.1:59188 - "POST /node/69ac41ef40deb775998f5e6e HTTP/1.0" 202 Accepted 2026-03-09 15:19:19,399 - lava_callback - INFO - Starting async job submit for node 69ac41ef40deb775998f5e6e 2026-03-09 15:19:19,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:19:19,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac41ef40deb775998f5e6e HTTP/1.1" 200 None 2026-03-09 15:19:19,415 - lava_callback - DEBUG - Processing node 69ac41ef40deb775998f5e6e: baseline-arm64-baylibre 2026-03-09 15:19:19,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac41ef40deb775998f5e6e 2026-03-09 15:19:19,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:19:19,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac41ef40deb775998f5e6e HTTP/1.1" 200 None 2026-03-09 15:19:19,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:19:19,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:19:19,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:19:19,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac41ef40deb775998f5e6e HTTP/1.1" 200 None 2026-03-09 15:19:19,469 - lava_callback - ERROR - Error processing callback for node 69ac41ef40deb775998f5e6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44800 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:20:53,719 - lava_callback - INFO - Received callback for node 69ac424340deb775998f5e87 INFO: 172.20.0.1:43766 - "POST /node/69ac424340deb775998f5e87 HTTP/1.0" 202 Accepted 2026-03-09 15:20:53,725 - lava_callback - INFO - Starting async job submit for node 69ac424340deb775998f5e87 2026-03-09 15:20:53,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:20:53,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac424340deb775998f5e87 HTTP/1.1" 200 None 2026-03-09 15:20:53,741 - lava_callback - DEBUG - Processing node 69ac424340deb775998f5e87: baseline-arm64-clabbe 2026-03-09 15:20:53,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac424340deb775998f5e87 2026-03-09 15:20:53,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:20:53,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac424340deb775998f5e87 HTTP/1.1" 200 None 2026-03-09 15:20:53,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:20:53,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:20:53,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:20:53,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac424340deb775998f5e87 HTTP/1.1" 200 None 2026-03-09 15:20:53,809 - lava_callback - ERROR - Error processing callback for node 69ac424340deb775998f5e87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:21:53,715 - lava_callback - INFO - Received callback for node 69ac428e40deb775998f5ea6 INFO: 172.20.0.1:38236 - "POST /node/69ac428e40deb775998f5ea6 HTTP/1.0" 202 Accepted 2026-03-09 15:21:53,721 - lava_callback - INFO - Starting async job submit for node 69ac428e40deb775998f5ea6 2026-03-09 15:21:53,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:21:53,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac428e40deb775998f5ea6 HTTP/1.1" 200 None 2026-03-09 15:21:53,737 - lava_callback - DEBUG - Processing node 69ac428e40deb775998f5ea6: baseline-arm64-clabbe 2026-03-09 15:21:53,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac428e40deb775998f5ea6 2026-03-09 15:21:53,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:21:53,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac428e40deb775998f5ea6 HTTP/1.1" 200 None 2026-03-09 15:21:53,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:21:53,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-09 15:21:53,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:21:53,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac428e40deb775998f5ea6 HTTP/1.1" 200 None 2026-03-09 15:21:53,831 - lava_callback - ERROR - Error processing callback for node 69ac428e40deb775998f5ea6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:22:38,955 - lava_callback - INFO - Received callback for node 69aee049feb96b28aa34c07a INFO: 172.20.0.1:53254 - "POST /node/69aee049feb96b28aa34c07a HTTP/1.0" 202 Accepted 2026-03-09 15:22:38,961 - lava_callback - INFO - Starting async job submit for node 69aee049feb96b28aa34c07a 2026-03-09 15:22:38,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:22:39,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee049feb96b28aa34c07a HTTP/1.1" 200 None 2026-03-09 15:22:39,013 - lava_callback - DEBUG - Processing node 69aee049feb96b28aa34c07a: baseline-arm64-broonie 2026-03-09 15:22:39,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:22:39,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:22:39,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee049feb96b28aa34c07a/log.txt.gz 2026-03-09 15:22:39,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:22:39,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:22:39,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee049feb96b28aa34c07a/lava-logs.yaml 2026-03-09 15:22:40,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:22:40,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:22:40,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee049feb96b28aa34c07a/lava_callback.json.gz DEBUG: Setup failed for 69aee049feb96b28aa34c07a. Transitting job node result: incomplete -> fail 2026-03-09 15:22:40,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:22:40,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee049feb96b28aa34c07a HTTP/1.1" 200 None 2026-03-09 15:22:40,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:22:40,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:22:40,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:22:40,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee049feb96b28aa34c07a HTTP/1.1" 200 None 2026-03-09 15:22:40,380 - lava_callback - INFO - Completed processing callback for node 69aee049feb96b28aa34c07a INFO: 172.20.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:23:05,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:23:05,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32808 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:23:13,708 - lava_callback - INFO - Received callback for node 69aee215feb96b28aa34c12d INFO: 172.20.0.1:51356 - "POST /node/69aee215feb96b28aa34c12d HTTP/1.0" 202 Accepted 2026-03-09 15:23:13,714 - lava_callback - INFO - Starting async job submit for node 69aee215feb96b28aa34c12d 2026-03-09 15:23:13,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:23:13,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee215feb96b28aa34c12d HTTP/1.1" 200 None 2026-03-09 15:23:13,807 - lava_callback - DEBUG - Processing node 69aee215feb96b28aa34c12d: baseline-arm 2026-03-09 15:23:14,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:23:14,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:23:14,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69aee215feb96b28aa34c12d/log.txt.gz 2026-03-09 15:23:14,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:23:15,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:23:15,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69aee215feb96b28aa34c12d/lava-logs.yaml 2026-03-09 15:23:15,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51366 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-09 15:23:15,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:23:15,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69aee215feb96b28aa34c12d/lava_callback.json.gz DEBUG: Setup failed for 69aee215feb96b28aa34c12d. Transitting job node result: incomplete -> fail 2026-03-09 15:23:15,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:23:15,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee215feb96b28aa34c12d HTTP/1.1" 200 None 2026-03-09 15:23:15,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:23:15,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 15:23:15,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:23:15,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee215feb96b28aa34c12d HTTP/1.1" 200 None 2026-03-09 15:23:15,578 - lava_callback - INFO - Completed processing callback for node 69aee215feb96b28aa34c12d INFO: 172.20.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40642 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:23:35,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:23:35,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:25:17,080 - lava_callback - INFO - Received callback for node 69aee649feb96b28aa34c2b0 INFO: 172.20.0.1:41062 - "POST /node/69aee649feb96b28aa34c2b0 HTTP/1.0" 202 Accepted 2026-03-09 15:25:17,087 - lava_callback - INFO - Starting async job submit for node 69aee649feb96b28aa34c2b0 2026-03-09 15:25:17,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:25:17,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee649feb96b28aa34c2b0 HTTP/1.1" 200 None 2026-03-09 15:25:17,142 - lava_callback - DEBUG - Processing node 69aee649feb96b28aa34c2b0: baseline-arm64-foundriesio 2026-03-09 15:25:17,192 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:25:17,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:25:17,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:25:17,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aee649feb96b28aa34c2b0/lava-logs.yaml 2026-03-09 15:25:17,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:25:17,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:25:17,532 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aee649feb96b28aa34c2b0/lava_callback.json.gz 2026-03-09 15:25:17,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:25:17,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee649feb96b28aa34c2b0 HTTP/1.1" 200 None 2026-03-09 15:25:17,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:25:17,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:25:17,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:25:17,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee649feb96b28aa34c2b0 HTTP/1.1" 200 None 2026-03-09 15:25:17,645 - lava_callback - INFO - Completed processing callback for node 69aee649feb96b28aa34c2b0 INFO: 172.20.0.1:60866 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:25:35,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:25:35,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55676 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:27:59,747 - lava_callback - INFO - Received callback for node 69ac43ee40deb775998f5f25 INFO: 172.20.0.1:59674 - "POST /node/69ac43ee40deb775998f5f25 HTTP/1.0" 202 Accepted 2026-03-09 15:27:59,753 - lava_callback - INFO - Starting async job submit for node 69ac43ee40deb775998f5f25 2026-03-09 15:27:59,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:27:59,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac43ee40deb775998f5f25 HTTP/1.1" 200 None 2026-03-09 15:27:59,769 - lava_callback - DEBUG - Processing node 69ac43ee40deb775998f5f25: baseline-arm64-baylibre 2026-03-09 15:27:59,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac43ee40deb775998f5f25 2026-03-09 15:27:59,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:27:59,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac43ee40deb775998f5f25 HTTP/1.1" 200 None 2026-03-09 15:27:59,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:27:59,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:27:59,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:27:59,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac43ee40deb775998f5f25 HTTP/1.1" 200 None 2026-03-09 15:27:59,830 - lava_callback - ERROR - Error processing callback for node 69ac43ee40deb775998f5f25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 15:28:04,942 - lava_callback - INFO - Received callback for node 69aee6e0feb96b28aa34c2c6 INFO: 172.20.0.1:59676 - "POST /node/69aee6e0feb96b28aa34c2c6 HTTP/1.0" 202 Accepted 2026-03-09 15:28:04,948 - lava_callback - INFO - Starting async job submit for node 69aee6e0feb96b28aa34c2c6 2026-03-09 15:28:04,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:04,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee6e0feb96b28aa34c2c6 HTTP/1.1" 200 None 2026-03-09 15:28:04,965 - lava_callback - DEBUG - Processing node 69aee6e0feb96b28aa34c2c6: baseline-arm64-broonie 2026-03-09 15:28:04,971 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:28:04,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:28:05,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:28:05,126 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee6e0feb96b28aa34c2c6/lava-logs.yaml 2026-03-09 15:28:05,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:28:05,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:28:05,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee6e0feb96b28aa34c2c6/lava_callback.json.gz 2026-03-09 15:28:05,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:05,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee6e0feb96b28aa34c2c6 HTTP/1.1" 200 None 2026-03-09 15:28:05,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:05,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:28:05,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:05,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee6e0feb96b28aa34c2c6 HTTP/1.1" 200 None 2026-03-09 15:28:05,363 - lava_callback - INFO - Completed processing callback for node 69aee6e0feb96b28aa34c2c6 2026-03-09 15:28:05,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:05,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36252 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:28:59,747 - lava_callback - INFO - Received callback for node 69ac443840deb775998f5f44 INFO: 172.20.0.1:45758 - "POST /node/69ac443840deb775998f5f44 HTTP/1.0" 202 Accepted 2026-03-09 15:28:59,752 - lava_callback - INFO - Starting async job submit for node 69ac443840deb775998f5f44 2026-03-09 15:28:59,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:59,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac443840deb775998f5f44 HTTP/1.1" 200 None 2026-03-09 15:28:59,768 - lava_callback - DEBUG - Processing node 69ac443840deb775998f5f44: baseline-arm64-baylibre 2026-03-09 15:28:59,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac443840deb775998f5f44 2026-03-09 15:28:59,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:59,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac443840deb775998f5f44 HTTP/1.1" 200 None 2026-03-09 15:28:59,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:59,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:28:59,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:28:59,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac443840deb775998f5f44 HTTP/1.1" 200 None 2026-03-09 15:28:59,828 - lava_callback - ERROR - Error processing callback for node 69ac443840deb775998f5f44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35542 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:30:19,870 - lava_callback - INFO - Received callback for node 69ac448140deb775998f5f5d INFO: 172.20.0.1:59956 - "POST /node/69ac448140deb775998f5f5d HTTP/1.0" 202 Accepted 2026-03-09 15:30:19,876 - lava_callback - INFO - Starting async job submit for node 69ac448140deb775998f5f5d 2026-03-09 15:30:19,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:30:19,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac448140deb775998f5f5d HTTP/1.1" 200 None 2026-03-09 15:30:19,900 - lava_callback - DEBUG - Processing node 69ac448140deb775998f5f5d: baseline-arm64-baylibre 2026-03-09 15:30:19,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac448140deb775998f5f5d 2026-03-09 15:30:19,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:30:19,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac448140deb775998f5f5d HTTP/1.1" 200 None 2026-03-09 15:30:19,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:30:19,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:30:19,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:30:19,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac448140deb775998f5f5d HTTP/1.1" 200 None 2026-03-09 15:30:19,962 - lava_callback - ERROR - Error processing callback for node 69ac448140deb775998f5f5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45096 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:31:40,110 - lava_callback - INFO - Received callback for node 69ac44cb40deb775998f5f6f INFO: 172.20.0.1:59762 - "POST /node/69ac44cb40deb775998f5f6f HTTP/1.0" 202 Accepted 2026-03-09 15:31:40,115 - lava_callback - INFO - Starting async job submit for node 69ac44cb40deb775998f5f6f 2026-03-09 15:31:40,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:31:40,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac44cb40deb775998f5f6f HTTP/1.1" 200 None 2026-03-09 15:31:40,132 - lava_callback - DEBUG - Processing node 69ac44cb40deb775998f5f6f: baseline-arm64-baylibre 2026-03-09 15:31:40,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac44cb40deb775998f5f6f 2026-03-09 15:31:40,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:31:40,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac44cb40deb775998f5f6f HTTP/1.1" 200 None 2026-03-09 15:31:40,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:31:40,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:31:40,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:31:40,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac44cb40deb775998f5f6f HTTP/1.1" 200 None 2026-03-09 15:31:40,201 - lava_callback - ERROR - Error processing callback for node 69ac44cb40deb775998f5f6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58840 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:32:39,962 - lava_callback - INFO - Received callback for node 69ac451640deb775998f5f8a INFO: 172.20.0.1:53374 - "POST /node/69ac451640deb775998f5f8a HTTP/1.0" 202 Accepted 2026-03-09 15:32:39,968 - lava_callback - INFO - Starting async job submit for node 69ac451640deb775998f5f8a 2026-03-09 15:32:39,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:32:39,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac451640deb775998f5f8a HTTP/1.1" 200 None 2026-03-09 15:32:39,984 - lava_callback - DEBUG - Processing node 69ac451640deb775998f5f8a: baseline-arm64-baylibre 2026-03-09 15:32:39,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac451640deb775998f5f8a 2026-03-09 15:32:39,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:32:39,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac451640deb775998f5f8a HTTP/1.1" 200 None 2026-03-09 15:32:39,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:32:40,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:32:40,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:32:40,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac451640deb775998f5f8a HTTP/1.1" 200 None 2026-03-09 15:32:40,040 - lava_callback - ERROR - Error processing callback for node 69ac451640deb775998f5f8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47854 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:33:14,375 - lava_callback - INFO - Received callback for node 69aee812feb96b28aa34c2fc INFO: 172.20.0.1:54302 - "POST /node/69aee812feb96b28aa34c2fc HTTP/1.0" 202 Accepted 2026-03-09 15:33:14,381 - lava_callback - INFO - Starting async job submit for node 69aee812feb96b28aa34c2fc 2026-03-09 15:33:14,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:33:14,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee812feb96b28aa34c2fc HTTP/1.1" 200 None 2026-03-09 15:33:14,418 - lava_callback - DEBUG - Processing node 69aee812feb96b28aa34c2fc: baseline-arm64-clabbe 2026-03-09 15:33:14,422 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:33:14,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:33:14,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:33:14,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69aee812feb96b28aa34c2fc/lava-logs.yaml 2026-03-09 15:33:14,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:33:14,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:33:14,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69aee812feb96b28aa34c2fc/lava_callback.json.gz 2026-03-09 15:33:14,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:33:14,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee812feb96b28aa34c2fc HTTP/1.1" 200 None 2026-03-09 15:33:14,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:33:14,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:33:14,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:33:14,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee812feb96b28aa34c2fc HTTP/1.1" 200 None 2026-03-09 15:33:14,782 - lava_callback - INFO - Completed processing callback for node 69aee812feb96b28aa34c2fc INFO: 172.20.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44162 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:33:35,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:33:35,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36562 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:34:00,096 - lava_callback - INFO - Received callback for node 69ac455f40deb775998f5fa9 INFO: 172.20.0.1:35424 - "POST /node/69ac455f40deb775998f5fa9 HTTP/1.0" 202 Accepted 2026-03-09 15:34:00,102 - lava_callback - INFO - Starting async job submit for node 69ac455f40deb775998f5fa9 2026-03-09 15:34:00,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:34:00,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac455f40deb775998f5fa9 HTTP/1.1" 200 None 2026-03-09 15:34:00,118 - lava_callback - DEBUG - Processing node 69ac455f40deb775998f5fa9: baseline-arm64-baylibre 2026-03-09 15:34:00,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac455f40deb775998f5fa9 2026-03-09 15:34:00,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:34:00,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac455f40deb775998f5fa9 HTTP/1.1" 200 None 2026-03-09 15:34:00,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:34:00,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:34:00,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:34:00,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac455f40deb775998f5fa9 HTTP/1.1" 200 None 2026-03-09 15:34:00,196 - lava_callback - ERROR - Error processing callback for node 69ac455f40deb775998f5fa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40994 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:35:20,165 - lava_callback - INFO - Received callback for node 69ac45a840deb775998f5fb8 INFO: 172.20.0.1:37828 - "POST /node/69ac45a840deb775998f5fb8 HTTP/1.0" 202 Accepted 2026-03-09 15:35:20,170 - lava_callback - INFO - Starting async job submit for node 69ac45a840deb775998f5fb8 2026-03-09 15:35:20,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:35:20,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac45a840deb775998f5fb8 HTTP/1.1" 200 None 2026-03-09 15:35:20,187 - lava_callback - DEBUG - Processing node 69ac45a840deb775998f5fb8: baseline-arm64-baylibre 2026-03-09 15:35:20,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac45a840deb775998f5fb8 2026-03-09 15:35:20,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:35:20,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac45a840deb775998f5fb8 HTTP/1.1" 200 None 2026-03-09 15:35:20,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:35:20,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:35:20,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:35:20,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac45a840deb775998f5fb8 HTTP/1.1" 200 None 2026-03-09 15:35:20,249 - lava_callback - ERROR - Error processing callback for node 69ac45a840deb775998f5fb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55046 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:36:20,171 - lava_callback - INFO - Received callback for node 69ac45f140deb775998f5fe2 INFO: 172.20.0.1:34852 - "POST /node/69ac45f140deb775998f5fe2 HTTP/1.0" 202 Accepted 2026-03-09 15:36:20,177 - lava_callback - INFO - Starting async job submit for node 69ac45f140deb775998f5fe2 2026-03-09 15:36:20,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:36:20,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac45f140deb775998f5fe2 HTTP/1.1" 200 None 2026-03-09 15:36:20,194 - lava_callback - DEBUG - Processing node 69ac45f140deb775998f5fe2: baseline-arm64-baylibre 2026-03-09 15:36:20,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac45f140deb775998f5fe2 2026-03-09 15:36:20,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:36:20,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac45f140deb775998f5fe2 HTTP/1.1" 200 None 2026-03-09 15:36:20,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:36:20,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:36:20,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:36:20,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac45f140deb775998f5fe2 HTTP/1.1" 200 None 2026-03-09 15:36:20,254 - lava_callback - ERROR - Error processing callback for node 69ac45f140deb775998f5fe2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60818 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:37:54,471 - lava_callback - INFO - Received callback for node 69ac463e40deb775998f5ff7 INFO: 172.20.0.1:43950 - "POST /node/69ac463e40deb775998f5ff7 HTTP/1.0" 202 Accepted 2026-03-09 15:37:54,477 - lava_callback - INFO - Starting async job submit for node 69ac463e40deb775998f5ff7 2026-03-09 15:37:54,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:37:54,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac463e40deb775998f5ff7 HTTP/1.1" 200 None 2026-03-09 15:37:54,492 - lava_callback - DEBUG - Processing node 69ac463e40deb775998f5ff7: baseline-arm64-clabbe 2026-03-09 15:37:54,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac463e40deb775998f5ff7 2026-03-09 15:37:54,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:37:54,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac463e40deb775998f5ff7 HTTP/1.1" 200 None 2026-03-09 15:37:54,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:37:54,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:37:54,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:37:54,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac463e40deb775998f5ff7 HTTP/1.1" 200 None 2026-03-09 15:37:54,548 - lava_callback - ERROR - Error processing callback for node 69ac463e40deb775998f5ff7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35364 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:38:34,899 - lava_callback - INFO - Received callback for node 69aee4e0feb96b28aa34c240 INFO: 172.20.0.1:47472 - "POST /node/69aee4e0feb96b28aa34c240 HTTP/1.0" 202 Accepted 2026-03-09 15:38:34,945 - lava_callback - INFO - Starting async job submit for node 69aee4e0feb96b28aa34c240 2026-03-09 15:38:34,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:34,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee4e0feb96b28aa34c240 HTTP/1.1" 200 None 2026-03-09 15:38:34,983 - lava_callback - DEBUG - Processing node 69aee4e0feb96b28aa34c240: baseline-arm-pengutronix 2026-03-09 15:38:35,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:38:35,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:38:35,282 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aee4e0feb96b28aa34c240/log.txt.gz 2026-03-09 15:38:35,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:38:35,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:38:35,532 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aee4e0feb96b28aa34c240/lava-logs.yaml 2026-03-09 15:38:35,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:38:35,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:38:35,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69aee4e0feb96b28aa34c240/lava_callback.json.gz DEBUG: Setup failed for 69aee4e0feb96b28aa34c240. Transitting job node result: incomplete -> fail 2026-03-09 15:38:35,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:35,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee4e0feb96b28aa34c240 HTTP/1.1" 200 None 2026-03-09 15:38:35,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:35,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba33feb96b28aa34a775 HTTP/1.1" 200 None 2026-03-09 15:38:35,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:35,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee4e0feb96b28aa34c240 HTTP/1.1" 200 None 2026-03-09 15:38:35,822 - lava_callback - INFO - Completed processing callback for node 69aee4e0feb96b28aa34c240 INFO: 172.20.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59302 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:38:54,457 - lava_callback - INFO - Received callback for node 69ac468740deb775998f6013 INFO: 172.20.0.1:51830 - "POST /node/69ac468740deb775998f6013 HTTP/1.0" 202 Accepted 2026-03-09 15:38:54,462 - lava_callback - INFO - Starting async job submit for node 69ac468740deb775998f6013 2026-03-09 15:38:54,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:54,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac468740deb775998f6013 HTTP/1.1" 200 None 2026-03-09 15:38:54,478 - lava_callback - DEBUG - Processing node 69ac468740deb775998f6013: baseline-arm64-clabbe 2026-03-09 15:38:54,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac468740deb775998f6013 2026-03-09 15:38:54,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:54,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac468740deb775998f6013 HTTP/1.1" 200 None 2026-03-09 15:38:54,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:54,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-09 15:38:54,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:38:54,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac468740deb775998f6013 HTTP/1.1" 200 None 2026-03-09 15:38:54,537 - lava_callback - ERROR - Error processing callback for node 69ac468740deb775998f6013: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51848 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:39:05,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:39:05,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51650 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:40:00,440 - lava_callback - INFO - Received callback for node 69ac46cc40deb775998f602d INFO: 172.20.0.1:37264 - "POST /node/69ac46cc40deb775998f602d HTTP/1.0" 202 Accepted 2026-03-09 15:40:00,446 - lava_callback - INFO - Starting async job submit for node 69ac46cc40deb775998f602d 2026-03-09 15:40:00,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:00,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac46cc40deb775998f602d HTTP/1.1" 200 None 2026-03-09 15:40:00,463 - lava_callback - DEBUG - Processing node 69ac46cc40deb775998f602d: baseline-arm64-baylibre 2026-03-09 15:40:00,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac46cc40deb775998f602d 2026-03-09 15:40:00,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:00,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac46cc40deb775998f602d HTTP/1.1" 200 None 2026-03-09 15:40:00,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:00,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-09 15:40:00,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:00,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac46cc40deb775998f602d HTTP/1.1" 200 None 2026-03-09 15:40:00,528 - lava_callback - ERROR - Error processing callback for node 69ac46cc40deb775998f602d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54478 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:40:41,412 - lava_callback - INFO - Received callback for node 69aee9d7feb96b28aa34c351 INFO: 172.20.0.1:50968 - "POST /node/69aee9d7feb96b28aa34c351 HTTP/1.0" 202 Accepted 2026-03-09 15:40:41,419 - lava_callback - INFO - Starting async job submit for node 69aee9d7feb96b28aa34c351 2026-03-09 15:40:41,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:41,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee9d7feb96b28aa34c351 HTTP/1.1" 200 None 2026-03-09 15:40:41,456 - lava_callback - DEBUG - Processing node 69aee9d7feb96b28aa34c351: baseline-arm64 2026-03-09 15:40:41,505 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:40:41,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:40:41,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:40:41,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee9d7feb96b28aa34c351/lava-logs.yaml 2026-03-09 15:40:41,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:40:41,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:40:41,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aee9d7feb96b28aa34c351/lava_callback.json.gz 2026-03-09 15:40:41,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:41,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee9d7feb96b28aa34c351 HTTP/1.1" 200 None 2026-03-09 15:40:41,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:41,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:40:41,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:40:41,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee9d7feb96b28aa34c351 HTTP/1.1" 200 None 2026-03-09 15:40:42,037 - lava_callback - INFO - Completed processing callback for node 69aee9d7feb96b28aa34c351 INFO: 172.20.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55406 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:41:05,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:41:05,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35098 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:41:34,564 - lava_callback - INFO - Received callback for node 69ac471b40deb775998f6047 INFO: 172.20.0.1:46392 - "POST /node/69ac471b40deb775998f6047 HTTP/1.0" 202 Accepted 2026-03-09 15:41:34,569 - lava_callback - INFO - Starting async job submit for node 69ac471b40deb775998f6047 2026-03-09 15:41:34,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:41:34,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac471b40deb775998f6047 HTTP/1.1" 200 None 2026-03-09 15:41:34,587 - lava_callback - DEBUG - Processing node 69ac471b40deb775998f6047: baseline-arm64-clabbe 2026-03-09 15:41:34,587 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac471b40deb775998f6047 2026-03-09 15:41:34,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:41:34,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac471b40deb775998f6047 HTTP/1.1" 200 None 2026-03-09 15:41:34,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:41:34,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-09 15:41:34,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:41:34,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac471b40deb775998f6047 HTTP/1.1" 200 None 2026-03-09 15:41:34,660 - lava_callback - ERROR - Error processing callback for node 69ac471b40deb775998f6047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57724 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:42:40,735 - lava_callback - INFO - Received callback for node 69ac475d40deb775998f6059 INFO: 172.20.0.1:54214 - "POST /node/69ac475d40deb775998f6059 HTTP/1.0" 202 Accepted 2026-03-09 15:42:40,740 - lava_callback - INFO - Starting async job submit for node 69ac475d40deb775998f6059 2026-03-09 15:42:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:42:40,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac475d40deb775998f6059 HTTP/1.1" 200 None 2026-03-09 15:42:40,756 - lava_callback - DEBUG - Processing node 69ac475d40deb775998f6059: baseline-arm64-baylibre 2026-03-09 15:42:40,756 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac475d40deb775998f6059 2026-03-09 15:42:40,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:42:40,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac475d40deb775998f6059 HTTP/1.1" 200 None 2026-03-09 15:42:40,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:42:40,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-09 15:42:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:42:40,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac475d40deb775998f6059 HTTP/1.1" 200 None 2026-03-09 15:42:40,808 - lava_callback - ERROR - Error processing callback for node 69ac475d40deb775998f6059: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41250 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:43:45,476 - lava_callback - INFO - Received callback for node 69aee77cfeb96b28aa34c2e0 INFO: 172.20.0.1:44348 - "POST /node/69aee77cfeb96b28aa34c2e0 HTTP/1.0" 202 Accepted 2026-03-09 15:43:45,483 - lava_callback - INFO - Starting async job submit for node 69aee77cfeb96b28aa34c2e0 2026-03-09 15:43:45,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:45,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee77cfeb96b28aa34c2e0 HTTP/1.1" 200 None 2026-03-09 15:43:45,500 - lava_callback - DEBUG - Processing node 69aee77cfeb96b28aa34c2e0: baseline-arm64-broonie 2026-03-09 15:43:45,505 - lava_callback - WARNING - Failed to upload log 2026-03-09 15:43:45,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:43:45,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:43:45,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee77cfeb96b28aa34c2e0/lava-logs.yaml 2026-03-09 15:43:45,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:43:45,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:43:45,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee77cfeb96b28aa34c2e0/lava_callback.json.gz 2026-03-09 15:43:45,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:45,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee77cfeb96b28aa34c2e0 HTTP/1.1" 200 None 2026-03-09 15:43:45,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:45,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:43:45,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:45,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee77cfeb96b28aa34c2e0 HTTP/1.1" 200 None 2026-03-09 15:43:45,904 - lava_callback - INFO - Completed processing callback for node 69aee77cfeb96b28aa34c2e0 INFO: 172.20.0.1:44362 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:43:54,682 - lava_callback - INFO - Received callback for node 69ac47ae40deb775998f6079 INFO: 172.20.0.1:47182 - "POST /node/69ac47ae40deb775998f6079 HTTP/1.0" 202 Accepted 2026-03-09 15:43:54,687 - lava_callback - INFO - Starting async job submit for node 69ac47ae40deb775998f6079 2026-03-09 15:43:54,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:54,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac47ae40deb775998f6079 HTTP/1.1" 200 None 2026-03-09 15:43:54,702 - lava_callback - DEBUG - Processing node 69ac47ae40deb775998f6079: baseline-arm64-clabbe 2026-03-09 15:43:54,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac47ae40deb775998f6079 2026-03-09 15:43:54,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:54,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac47ae40deb775998f6079 HTTP/1.1" 200 None 2026-03-09 15:43:54,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:54,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aafea227cb11dcdfc758f1 HTTP/1.1" 200 None 2026-03-09 15:43:54,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:43:54,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac47ae40deb775998f6079 HTTP/1.1" 200 None 2026-03-09 15:43:54,760 - lava_callback - ERROR - Error processing callback for node 69ac47ae40deb775998f6079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47204 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:44:05,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:44:05,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36614 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:45:00,814 - lava_callback - INFO - Received callback for node 69ac47f140deb775998f6094 INFO: 172.20.0.1:58720 - "POST /node/69ac47f140deb775998f6094 HTTP/1.0" 202 Accepted 2026-03-09 15:45:00,820 - lava_callback - INFO - Starting async job submit for node 69ac47f140deb775998f6094 2026-03-09 15:45:00,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:45:00,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac47f140deb775998f6094 HTTP/1.1" 200 None 2026-03-09 15:45:00,836 - lava_callback - DEBUG - Processing node 69ac47f140deb775998f6094: baseline-arm64-baylibre 2026-03-09 15:45:00,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac47f140deb775998f6094 2026-03-09 15:45:00,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:45:00,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac47f140deb775998f6094 HTTP/1.1" 200 None 2026-03-09 15:45:00,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:45:00,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-09 15:45:00,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:45:00,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac47f140deb775998f6094 HTTP/1.1" 200 None 2026-03-09 15:45:00,906 - lava_callback - ERROR - Error processing callback for node 69ac47f140deb775998f6094: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:46:00,687 - lava_callback - INFO - Received callback for node 69ac482d40deb775998f60a3 INFO: 172.20.0.1:60756 - "POST /node/69ac482d40deb775998f60a3 HTTP/1.0" 202 Accepted 2026-03-09 15:46:00,692 - lava_callback - INFO - Starting async job submit for node 69ac482d40deb775998f60a3 2026-03-09 15:46:00,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:00,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac482d40deb775998f60a3 HTTP/1.1" 200 None 2026-03-09 15:46:00,708 - lava_callback - DEBUG - Processing node 69ac482d40deb775998f60a3: baseline-arm-baylibre 2026-03-09 15:46:00,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac482d40deb775998f60a3 2026-03-09 15:46:00,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:00,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac482d40deb775998f60a3 HTTP/1.1" 200 None 2026-03-09 15:46:00,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:00,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:46:00,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:00,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac482d40deb775998f60a3 HTTP/1.1" 200 None 2026-03-09 15:46:00,766 - lava_callback - ERROR - Error processing callback for node 69ac482d40deb775998f60a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:46:40,788 - lava_callback - INFO - Received callback for node 69ac485e40deb775998f60b5 INFO: 172.20.0.1:44000 - "POST /node/69ac485e40deb775998f60b5 HTTP/1.0" 202 Accepted 2026-03-09 15:46:40,793 - lava_callback - INFO - Starting async job submit for node 69ac485e40deb775998f60b5 2026-03-09 15:46:40,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:40,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac485e40deb775998f60b5 HTTP/1.1" 200 None 2026-03-09 15:46:40,810 - lava_callback - DEBUG - Processing node 69ac485e40deb775998f60b5: baseline-arm64-baylibre 2026-03-09 15:46:40,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac485e40deb775998f60b5 2026-03-09 15:46:40,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:40,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac485e40deb775998f60b5 HTTP/1.1" 200 None 2026-03-09 15:46:40,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:40,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-09 15:46:40,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:40,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac485e40deb775998f60b5 HTTP/1.1" 200 None 2026-03-09 15:46:40,866 - lava_callback - ERROR - Error processing callback for node 69ac485e40deb775998f60b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 15:46:46,144 - lava_callback - INFO - Received callback for node 69aee55cfeb96b28aa34c27b INFO: 172.20.0.1:44006 - "POST /node/69aee55cfeb96b28aa34c27b HTTP/1.0" 202 Accepted 2026-03-09 15:46:46,150 - lava_callback - INFO - Starting async job submit for node 69aee55cfeb96b28aa34c27b 2026-03-09 15:46:46,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:46,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee55cfeb96b28aa34c27b HTTP/1.1" 200 None 2026-03-09 15:46:46,202 - lava_callback - DEBUG - Processing node 69aee55cfeb96b28aa34c27b: baseline-arm64-broonie INFO: 172.20.0.1:44022 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:46:46,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:46:46,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:46:46,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee55cfeb96b28aa34c27b/log.txt.gz 2026-03-09 15:46:47,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:46:47,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:46:47,308 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee55cfeb96b28aa34c27b/lava-logs.yaml 2026-03-09 15:46:47,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:46:47,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:46:47,506 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee55cfeb96b28aa34c27b/lava_callback.json.gz DEBUG: Setup failed for 69aee55cfeb96b28aa34c27b. Transitting job node result: incomplete -> fail 2026-03-09 15:46:47,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:47,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee55cfeb96b28aa34c27b HTTP/1.1" 200 None 2026-03-09 15:46:47,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:47,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:46:47,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:46:47,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee55cfeb96b28aa34c27b HTTP/1.1" 200 None 2026-03-09 15:46:47,739 - lava_callback - INFO - Completed processing callback for node 69aee55cfeb96b28aa34c27b INFO: 172.20.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38672 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:47:05,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:05,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48310 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:47:07,807 - lava_callback - INFO - Received callback for node 69aeeb14feb96b28aa34c380 INFO: 172.20.0.1:48316 - "POST /node/69aeeb14feb96b28aa34c380 HTTP/1.0" 202 Accepted 2026-03-09 15:47:07,813 - lava_callback - INFO - Starting async job submit for node 69aeeb14feb96b28aa34c380 2026-03-09 15:47:07,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:07,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeb14feb96b28aa34c380 HTTP/1.1" 200 None 2026-03-09 15:47:07,858 - lava_callback - DEBUG - Processing node 69aeeb14feb96b28aa34c380: baseline-arm64 2026-03-09 15:47:08,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:47:08,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:47:08,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeb14feb96b28aa34c380/log.txt.gz 2026-03-09 15:47:08,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:47:08,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:47:08,801 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeb14feb96b28aa34c380/lava-logs.yaml 2026-03-09 15:47:08,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:47:08,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:47:08,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeb14feb96b28aa34c380/lava_callback.json.gz DEBUG: Setup failed for 69aeeb14feb96b28aa34c380. Transitting job node result: incomplete -> fail 2026-03-09 15:47:09,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:09,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeb14feb96b28aa34c380 HTTP/1.1" 200 None 2026-03-09 15:47:09,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:09,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:47:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:09,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeeb14feb96b28aa34c380 HTTP/1.1" 200 None 2026-03-09 15:47:09,127 - lava_callback - INFO - Completed processing callback for node 69aeeb14feb96b28aa34c380 INFO: 172.20.0.1:37648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35876 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:47:29,460 - lava_callback - INFO - Received callback for node 69aeeacafeb96b28aa34c377 INFO: 172.20.0.1:35888 - "POST /node/69aeeacafeb96b28aa34c377 HTTP/1.0" 202 Accepted 2026-03-09 15:47:29,466 - lava_callback - INFO - Starting async job submit for node 69aeeacafeb96b28aa34c377 2026-03-09 15:47:29,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:29,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeacafeb96b28aa34c377 HTTP/1.1" 200 None 2026-03-09 15:47:29,515 - lava_callback - DEBUG - Processing node 69aeeacafeb96b28aa34c377: baseline-nfs-arm64 2026-03-09 15:47:29,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:47:30,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:47:30,027 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeeacafeb96b28aa34c377/log.txt.gz 2026-03-09 15:47:30,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:47:30,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:47:30,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeeacafeb96b28aa34c377/lava-logs.yaml 2026-03-09 15:47:30,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:47:30,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:47:30,672 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeeacafeb96b28aa34c377/lava_callback.json.gz DEBUG: Setup failed for 69aeeacafeb96b28aa34c377. Transitting job node result: incomplete -> fail 2026-03-09 15:47:30,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:30,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeacafeb96b28aa34c377 HTTP/1.1" 200 None 2026-03-09 15:47:30,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:30,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:47:30,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:30,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeeacafeb96b28aa34c377 HTTP/1.1" 200 None 2026-03-09 15:47:30,912 - lava_callback - INFO - Completed processing callback for node 69aeeacafeb96b28aa34c377 2026-03-09 15:47:35,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:35,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52320 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:47:40,835 - lava_callback - INFO - Received callback for node 69ac489940deb775998f60c8 INFO: 172.20.0.1:43524 - "POST /node/69ac489940deb775998f60c8 HTTP/1.0" 202 Accepted 2026-03-09 15:47:40,841 - lava_callback - INFO - Starting async job submit for node 69ac489940deb775998f60c8 2026-03-09 15:47:40,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:40,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac489940deb775998f60c8 HTTP/1.1" 200 None 2026-03-09 15:47:40,856 - lava_callback - DEBUG - Processing node 69ac489940deb775998f60c8: baseline-arm-baylibre 2026-03-09 15:47:40,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac489940deb775998f60c8 2026-03-09 15:47:40,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:40,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac489940deb775998f60c8 HTTP/1.1" 200 None 2026-03-09 15:47:40,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:40,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:47:40,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:47:40,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac489940deb775998f60c8 HTTP/1.1" 200 None 2026-03-09 15:47:40,921 - lava_callback - ERROR - Error processing callback for node 69ac489940deb775998f60c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:48:07,250 - lava_callback - INFO - Received callback for node 69aeeb63feb96b28aa34c38d INFO: 172.20.0.1:45058 - "POST /node/69aeeb63feb96b28aa34c38d HTTP/1.0" 202 Accepted 2026-03-09 15:48:07,256 - lava_callback - INFO - Starting async job submit for node 69aeeb63feb96b28aa34c38d 2026-03-09 15:48:07,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:07,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeb63feb96b28aa34c38d HTTP/1.1" 200 None 2026-03-09 15:48:07,312 - lava_callback - DEBUG - Processing node 69aeeb63feb96b28aa34c38d: baseline-arm64 2026-03-09 15:48:07,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:48:07,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:48:07,833 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeb63feb96b28aa34c38d/log.txt.gz 2026-03-09 15:48:08,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:48:08,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:48:08,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeb63feb96b28aa34c38d/lava-logs.yaml 2026-03-09 15:48:08,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:48:08,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:48:08,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeb63feb96b28aa34c38d/lava_callback.json.gz DEBUG: Setup failed for 69aeeb63feb96b28aa34c38d. Transitting job node result: incomplete -> fail 2026-03-09 15:48:08,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:08,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeb63feb96b28aa34c38d HTTP/1.1" 200 None 2026-03-09 15:48:08,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:08,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:48:08,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:08,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeeb63feb96b28aa34c38d HTTP/1.1" 200 None 2026-03-09 15:48:08,677 - lava_callback - INFO - Completed processing callback for node 69aeeb63feb96b28aa34c38d INFO: 172.20.0.1:36718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:48:20,862 - lava_callback - INFO - Received callback for node 69ac48bf40deb775998f60d3 INFO: 172.20.0.1:34738 - "POST /node/69ac48bf40deb775998f60d3 HTTP/1.0" 202 Accepted 2026-03-09 15:48:20,867 - lava_callback - INFO - Starting async job submit for node 69ac48bf40deb775998f60d3 2026-03-09 15:48:20,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:20,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac48bf40deb775998f60d3 HTTP/1.1" 200 None 2026-03-09 15:48:20,884 - lava_callback - DEBUG - Processing node 69ac48bf40deb775998f60d3: baseline-arm-baylibre 2026-03-09 15:48:20,884 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac48bf40deb775998f60d3 2026-03-09 15:48:20,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:20,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac48bf40deb775998f60d3 HTTP/1.1" 200 None 2026-03-09 15:48:20,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:20,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:48:20,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:20,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac48bf40deb775998f60d3 HTTP/1.1" 200 None 2026-03-09 15:48:20,941 - lava_callback - ERROR - Error processing callback for node 69ac48bf40deb775998f60d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:48:35,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:48:35,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48114 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:49:00,908 - lava_callback - INFO - Received callback for node 69ac48e340deb775998f60e1 INFO: 172.20.0.1:35238 - "POST /node/69ac48e340deb775998f60e1 HTTP/1.0" 202 Accepted 2026-03-09 15:49:00,914 - lava_callback - INFO - Starting async job submit for node 69ac48e340deb775998f60e1 2026-03-09 15:49:00,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:00,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac48e340deb775998f60e1 HTTP/1.1" 200 None 2026-03-09 15:49:00,930 - lava_callback - DEBUG - Processing node 69ac48e340deb775998f60e1: baseline-arm-baylibre 2026-03-09 15:49:00,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac48e340deb775998f60e1 2026-03-09 15:49:00,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:00,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac48e340deb775998f60e1 HTTP/1.1" 200 None 2026-03-09 15:49:00,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:00,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:49:00,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:00,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac48e340deb775998f60e1 HTTP/1.1" 200 None 2026-03-09 15:49:00,995 - lava_callback - ERROR - Error processing callback for node 69ac48e340deb775998f60e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32888 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:49:41,022 - lava_callback - INFO - Received callback for node 69ac490740deb775998f60f1 INFO: 172.20.0.1:46928 - "POST /node/69ac490740deb775998f60f1 HTTP/1.0" 202 Accepted 2026-03-09 15:49:41,028 - lava_callback - INFO - Starting async job submit for node 69ac490740deb775998f60f1 2026-03-09 15:49:41,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:41,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac490740deb775998f60f1 HTTP/1.1" 200 None 2026-03-09 15:49:41,044 - lava_callback - DEBUG - Processing node 69ac490740deb775998f60f1: baseline-arm-baylibre 2026-03-09 15:49:41,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac490740deb775998f60f1 2026-03-09 15:49:41,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:41,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac490740deb775998f60f1 HTTP/1.1" 200 None 2026-03-09 15:49:41,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:41,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:49:41,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:41,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac490740deb775998f60f1 HTTP/1.1" 200 None 2026-03-09 15:49:41,109 - lava_callback - ERROR - Error processing callback for node 69ac490740deb775998f60f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 15:49:45,313 - lava_callback - INFO - Received callback for node 69aeebc5feb96b28aa34c3b2 INFO: 172.20.0.1:46944 - "POST /node/69aeebc5feb96b28aa34c3b2 HTTP/1.0" 202 Accepted 2026-03-09 15:49:45,319 - lava_callback - INFO - Starting async job submit for node 69aeebc5feb96b28aa34c3b2 2026-03-09 15:49:45,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:45,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeebc5feb96b28aa34c3b2 HTTP/1.1" 200 None 2026-03-09 15:49:45,364 - lava_callback - DEBUG - Processing node 69aeebc5feb96b28aa34c3b2: baseline-arm64-foundriesio 2026-03-09 15:49:45,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:49:45,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:49:45,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aeebc5feb96b28aa34c3b2/log.txt.gz 2026-03-09 15:49:45,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:49:46,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:49:46,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aeebc5feb96b28aa34c3b2/lava-logs.yaml 2026-03-09 15:49:46,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:49:46,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:49:46,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69aeebc5feb96b28aa34c3b2/lava_callback.json.gz DEBUG: Setup failed for 69aeebc5feb96b28aa34c3b2. Transitting job node result: incomplete -> fail 2026-03-09 15:49:46,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:46,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeebc5feb96b28aa34c3b2 HTTP/1.1" 200 None 2026-03-09 15:49:46,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:46,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:49:46,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:49:46,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeebc5feb96b28aa34c3b2 HTTP/1.1" 200 None INFO: 172.20.0.1:46946 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:49:46,537 - lava_callback - INFO - Completed processing callback for node 69aeebc5feb96b28aa34c3b2 INFO: 172.20.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40992 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:50:05,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:05,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49418 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:50:21,201 - lava_callback - INFO - Received callback for node 69ac492840deb775998f6103 INFO: 172.20.0.1:51196 - "POST /node/69ac492840deb775998f6103 HTTP/1.0" 202 Accepted 2026-03-09 15:50:21,207 - lava_callback - INFO - Starting async job submit for node 69ac492840deb775998f6103 2026-03-09 15:50:21,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:21,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac492840deb775998f6103 HTTP/1.1" 200 None 2026-03-09 15:50:21,223 - lava_callback - DEBUG - Processing node 69ac492840deb775998f6103: baseline-arm-baylibre 2026-03-09 15:50:21,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac492840deb775998f6103 2026-03-09 15:50:21,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:21,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac492840deb775998f6103 HTTP/1.1" 200 None 2026-03-09 15:50:21,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:21,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:50:21,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:21,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac492840deb775998f6103 HTTP/1.1" 200 None 2026-03-09 15:50:21,286 - lava_callback - ERROR - Error processing callback for node 69ac492840deb775998f6103: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44854 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:50:40,968 - lava_callback - INFO - Received callback for node 69ac494b40deb775998f610d INFO: 172.20.0.1:58370 - "POST /node/69ac494b40deb775998f610d HTTP/1.0" 202 Accepted 2026-03-09 15:50:40,973 - lava_callback - INFO - Starting async job submit for node 69ac494b40deb775998f610d 2026-03-09 15:50:40,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:40,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac494b40deb775998f610d HTTP/1.1" 200 None 2026-03-09 15:50:40,994 - lava_callback - DEBUG - Processing node 69ac494b40deb775998f610d: baseline-arm-baylibre 2026-03-09 15:50:40,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac494b40deb775998f610d 2026-03-09 15:50:40,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:41,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac494b40deb775998f610d HTTP/1.1" 200 None 2026-03-09 15:50:41,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:41,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:50:41,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:50:41,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac494b40deb775998f610d HTTP/1.1" 200 None 2026-03-09 15:50:41,053 - lava_callback - ERROR - Error processing callback for node 69ac494b40deb775998f610d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36586 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:51:21,140 - lava_callback - INFO - Received callback for node 69ac497040deb775998f611c INFO: 172.20.0.1:40232 - "POST /node/69ac497040deb775998f611c HTTP/1.0" 202 Accepted 2026-03-09 15:51:21,145 - lava_callback - INFO - Starting async job submit for node 69ac497040deb775998f611c 2026-03-09 15:51:21,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:21,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac497040deb775998f611c HTTP/1.1" 200 None 2026-03-09 15:51:21,161 - lava_callback - DEBUG - Processing node 69ac497040deb775998f611c: baseline-arm-baylibre 2026-03-09 15:51:21,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac497040deb775998f611c 2026-03-09 15:51:21,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:21,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac497040deb775998f611c HTTP/1.1" 200 None 2026-03-09 15:51:21,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:21,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:51:21,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:21,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac497040deb775998f611c HTTP/1.1" 200 None 2026-03-09 15:51:21,218 - lava_callback - ERROR - Error processing callback for node 69ac497040deb775998f611c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58038 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:51:36,824 - lava_callback - INFO - Received callback for node 69aeec03feb96b28aa34c3ba INFO: 172.20.0.1:58050 - "POST /node/69aeec03feb96b28aa34c3ba HTTP/1.0" 202 Accepted 2026-03-09 15:51:36,831 - lava_callback - INFO - Starting async job submit for node 69aeec03feb96b28aa34c3ba 2026-03-09 15:51:36,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:36,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeec03feb96b28aa34c3ba HTTP/1.1" 200 None 2026-03-09 15:51:36,878 - lava_callback - DEBUG - Processing node 69aeec03feb96b28aa34c3ba: baseline-nfs-arm64 2026-03-09 15:51:37,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:51:37,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:51:37,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeec03feb96b28aa34c3ba/log.txt.gz 2026-03-09 15:51:37,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:51:37,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:51:37,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeec03feb96b28aa34c3ba/lava-logs.yaml 2026-03-09 15:51:37,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:51:38,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:51:38,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeec03feb96b28aa34c3ba/lava_callback.json.gz DEBUG: Setup failed for 69aeec03feb96b28aa34c3ba. Transitting job node result: incomplete -> fail 2026-03-09 15:51:38,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeec03feb96b28aa34c3ba HTTP/1.1" 200 None 2026-03-09 15:51:38,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:38,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:51:38,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:51:38,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeec03feb96b28aa34c3ba HTTP/1.1" 200 None 2026-03-09 15:51:38,284 - lava_callback - INFO - Completed processing callback for node 69aeec03feb96b28aa34c3ba INFO: 172.20.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:52:01,085 - lava_callback - INFO - Received callback for node 69ac499240deb775998f6138 INFO: 172.20.0.1:37788 - "POST /node/69ac499240deb775998f6138 HTTP/1.0" 202 Accepted 2026-03-09 15:52:01,091 - lava_callback - INFO - Starting async job submit for node 69ac499240deb775998f6138 2026-03-09 15:52:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:01,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac499240deb775998f6138 HTTP/1.1" 200 None 2026-03-09 15:52:01,111 - lava_callback - DEBUG - Processing node 69ac499240deb775998f6138: baseline-arm-baylibre 2026-03-09 15:52:01,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac499240deb775998f6138 2026-03-09 15:52:01,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:01,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac499240deb775998f6138 HTTP/1.1" 200 None 2026-03-09 15:52:01,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:01,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:52:01,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:01,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac499240deb775998f6138 HTTP/1.1" 200 None 2026-03-09 15:52:01,169 - lava_callback - ERROR - Error processing callback for node 69ac499240deb775998f6138: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 15:52:05,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:05,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41488 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:52:26,670 - lava_callback - INFO - Received callback for node 69aeec4dfeb96b28aa34c3cc INFO: 172.20.0.1:41496 - "POST /node/69aeec4dfeb96b28aa34c3cc HTTP/1.0" 202 Accepted 2026-03-09 15:52:26,675 - lava_callback - INFO - Starting async job submit for node 69aeec4dfeb96b28aa34c3cc 2026-03-09 15:52:26,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:26,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeec4dfeb96b28aa34c3cc HTTP/1.1" 200 None 2026-03-09 15:52:26,732 - lava_callback - DEBUG - Processing node 69aeec4dfeb96b28aa34c3cc: baseline-arm64 2026-03-09 15:52:27,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:52:27,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:52:27,132 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeec4dfeb96b28aa34c3cc/log.txt.gz 2026-03-09 15:52:27,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:52:27,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:52:27,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeec4dfeb96b28aa34c3cc/lava-logs.yaml 2026-03-09 15:52:27,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:52:27,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:52:27,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeec4dfeb96b28aa34c3cc/lava_callback.json.gz DEBUG: Setup failed for 69aeec4dfeb96b28aa34c3cc. Transitting job node result: incomplete -> fail 2026-03-09 15:52:27,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:27,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeec4dfeb96b28aa34c3cc HTTP/1.1" 200 None 2026-03-09 15:52:27,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:27,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:52:27,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:27,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeec4dfeb96b28aa34c3cc HTTP/1.1" 200 None 2026-03-09 15:52:27,894 - lava_callback - INFO - Completed processing callback for node 69aeec4dfeb96b28aa34c3cc 2026-03-09 15:52:35,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:35,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47286 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:52:41,137 - lava_callback - INFO - Received callback for node 69ac49b640deb775998f6149 INFO: 172.20.0.1:33708 - "POST /node/69ac49b640deb775998f6149 HTTP/1.0" 202 Accepted 2026-03-09 15:52:41,142 - lava_callback - INFO - Starting async job submit for node 69ac49b640deb775998f6149 2026-03-09 15:52:41,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:41,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac49b640deb775998f6149 HTTP/1.1" 200 None 2026-03-09 15:52:41,159 - lava_callback - DEBUG - Processing node 69ac49b640deb775998f6149: baseline-arm-baylibre 2026-03-09 15:52:41,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac49b640deb775998f6149 2026-03-09 15:52:41,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:41,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac49b640deb775998f6149 HTTP/1.1" 200 None 2026-03-09 15:52:41,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:41,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:52:41,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:52:41,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac49b640deb775998f6149 HTTP/1.1" 200 None 2026-03-09 15:52:41,218 - lava_callback - ERROR - Error processing callback for node 69ac49b640deb775998f6149: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:53:01,100 - lava_callback - INFO - Received callback for node 69ac49d840deb775998f6152 INFO: 172.20.0.1:48878 - "POST /node/69ac49d840deb775998f6152 HTTP/1.0" 202 Accepted 2026-03-09 15:53:01,106 - lava_callback - INFO - Starting async job submit for node 69ac49d840deb775998f6152 2026-03-09 15:53:01,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:01,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac49d840deb775998f6152 HTTP/1.1" 200 None 2026-03-09 15:53:01,122 - lava_callback - DEBUG - Processing node 69ac49d840deb775998f6152: baseline-arm-baylibre 2026-03-09 15:53:01,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac49d840deb775998f6152 2026-03-09 15:53:01,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:01,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac49d840deb775998f6152 HTTP/1.1" 200 None 2026-03-09 15:53:01,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:01,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:53:01,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:01,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac49d840deb775998f6152 HTTP/1.1" 200 None 2026-03-09 15:53:01,178 - lava_callback - ERROR - Error processing callback for node 69ac49d840deb775998f6152: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35596 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:53:30,838 - lava_callback - INFO - Received callback for node 69aeec99feb96b28aa34c3da INFO: 172.20.0.1:38594 - "POST /node/69aeec99feb96b28aa34c3da HTTP/1.0" 202 Accepted 2026-03-09 15:53:30,845 - lava_callback - INFO - Starting async job submit for node 69aeec99feb96b28aa34c3da 2026-03-09 15:53:30,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:30,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeec99feb96b28aa34c3da HTTP/1.1" 200 None 2026-03-09 15:53:30,890 - lava_callback - DEBUG - Processing node 69aeec99feb96b28aa34c3da: baseline-arm64 2026-03-09 15:53:31,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:53:31,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:53:31,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeec99feb96b28aa34c3da/log.txt.gz 2026-03-09 15:53:31,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:53:32,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:53:32,122 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeec99feb96b28aa34c3da/lava-logs.yaml 2026-03-09 15:53:32,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:53:32,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:53:32,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeec99feb96b28aa34c3da/lava_callback.json.gz DEBUG: Setup failed for 69aeec99feb96b28aa34c3da. Transitting job node result: incomplete -> fail 2026-03-09 15:53:32,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:32,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeec99feb96b28aa34c3da HTTP/1.1" 200 None 2026-03-09 15:53:32,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:32,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:53:32,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:32,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeec99feb96b28aa34c3da HTTP/1.1" 200 None 2026-03-09 15:53:32,503 - lava_callback - INFO - Completed processing callback for node 69aeec99feb96b28aa34c3da 2026-03-09 15:53:35,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:35,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38598 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:53:41,155 - lava_callback - INFO - Received callback for node 69ac49fd40deb775998f615c INFO: 172.20.0.1:49342 - "POST /node/69ac49fd40deb775998f615c HTTP/1.0" 202 Accepted 2026-03-09 15:53:41,160 - lava_callback - INFO - Starting async job submit for node 69ac49fd40deb775998f615c 2026-03-09 15:53:41,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:41,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac49fd40deb775998f615c HTTP/1.1" 200 None 2026-03-09 15:53:41,185 - lava_callback - DEBUG - Processing node 69ac49fd40deb775998f615c: baseline-arm-baylibre 2026-03-09 15:53:41,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac49fd40deb775998f615c 2026-03-09 15:53:41,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:41,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac49fd40deb775998f615c HTTP/1.1" 200 None 2026-03-09 15:53:41,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:41,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-09 15:53:41,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:53:41,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac49fd40deb775998f615c HTTP/1.1" 200 None 2026-03-09 15:53:41,241 - lava_callback - ERROR - Error processing callback for node 69ac49fd40deb775998f615c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50096 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:54:21,332 - lava_callback - INFO - Received callback for node 69ac4a2a40deb775998f616f INFO: 172.20.0.1:52104 - "POST /node/69ac4a2a40deb775998f616f HTTP/1.0" 202 Accepted 2026-03-09 15:54:21,338 - lava_callback - INFO - Starting async job submit for node 69ac4a2a40deb775998f616f 2026-03-09 15:54:21,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:54:21,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4a2a40deb775998f616f HTTP/1.1" 200 None 2026-03-09 15:54:21,365 - lava_callback - DEBUG - Processing node 69ac4a2a40deb775998f616f: baseline-arm64-baylibre 2026-03-09 15:54:21,365 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac4a2a40deb775998f616f 2026-03-09 15:54:21,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:54:21,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4a2a40deb775998f616f HTTP/1.1" 200 None 2026-03-09 15:54:21,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:54:21,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-09 15:54:21,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:54:21,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac4a2a40deb775998f616f HTTP/1.1" 200 None 2026-03-09 15:54:21,452 - lava_callback - ERROR - Error processing callback for node 69ac4a2a40deb775998f616f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36070 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:55:41,290 - lava_callback - INFO - Received callback for node 69ac4a7440deb775998f6182 INFO: 172.20.0.1:49100 - "POST /node/69ac4a7440deb775998f6182 HTTP/1.0" 202 Accepted 2026-03-09 15:55:41,296 - lava_callback - INFO - Starting async job submit for node 69ac4a7440deb775998f6182 2026-03-09 15:55:41,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:55:41,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4a7440deb775998f6182 HTTP/1.1" 200 None 2026-03-09 15:55:41,312 - lava_callback - DEBUG - Processing node 69ac4a7440deb775998f6182: baseline-arm64-baylibre 2026-03-09 15:55:41,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac4a7440deb775998f6182 2026-03-09 15:55:41,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:55:41,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4a7440deb775998f6182 HTTP/1.1" 200 None 2026-03-09 15:55:41,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:55:41,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-09 15:55:41,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:55:41,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac4a7440deb775998f6182 HTTP/1.1" 200 None 2026-03-09 15:55:41,382 - lava_callback - ERROR - Error processing callback for node 69ac4a7440deb775998f6182: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48984 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:56:20,336 - lava_callback - INFO - Received callback for node 69aeece5feb96b28aa34c3f0 INFO: 172.20.0.1:38540 - "POST /node/69aeece5feb96b28aa34c3f0 HTTP/1.0" 202 Accepted 2026-03-09 15:56:20,342 - lava_callback - INFO - Starting async job submit for node 69aeece5feb96b28aa34c3f0 2026-03-09 15:56:20,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:20,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeece5feb96b28aa34c3f0 HTTP/1.1" 200 None 2026-03-09 15:56:20,388 - lava_callback - DEBUG - Processing node 69aeece5feb96b28aa34c3f0: baseline-arm64 2026-03-09 15:56:20,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:56:20,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:56:20,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeece5feb96b28aa34c3f0/log.txt.gz 2026-03-09 15:56:21,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:56:21,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:56:21,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeece5feb96b28aa34c3f0/lava-logs.yaml 2026-03-09 15:56:21,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:56:21,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:56:21,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeece5feb96b28aa34c3f0/lava_callback.json.gz DEBUG: Setup failed for 69aeece5feb96b28aa34c3f0. Transitting job node result: incomplete -> fail 2026-03-09 15:56:21,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:21,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeece5feb96b28aa34c3f0 HTTP/1.1" 200 None 2026-03-09 15:56:21,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:21,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:56:21,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:21,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeece5feb96b28aa34c3f0 HTTP/1.1" 200 None 2026-03-09 15:56:21,773 - lava_callback - INFO - Completed processing callback for node 69aeece5feb96b28aa34c3f0 INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:56:35,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:35,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-09 15:56:36,094 - lava_callback - INFO - Received callback for node 69aeed3dfeb96b28aa34c400 INFO: 172.20.0.1:35640 - "POST /node/69aeed3dfeb96b28aa34c400 HTTP/1.0" 202 Accepted 2026-03-09 15:56:36,101 - lava_callback - INFO - Starting async job submit for node 69aeed3dfeb96b28aa34c400 2026-03-09 15:56:36,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:36,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeed3dfeb96b28aa34c400 HTTP/1.1" 200 None 2026-03-09 15:56:36,149 - lava_callback - DEBUG - Processing node 69aeed3dfeb96b28aa34c400: baseline-nfs-arm64 2026-03-09 15:56:36,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:35652 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:56:36,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:56:36,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeed3dfeb96b28aa34c400/log.txt.gz 2026-03-09 15:56:36,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:56:36,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:56:36,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeed3dfeb96b28aa34c400/lava-logs.yaml 2026-03-09 15:56:37,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:56:37,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:56:37,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeed3dfeb96b28aa34c400/lava_callback.json.gz DEBUG: Setup failed for 69aeed3dfeb96b28aa34c400. Transitting job node result: incomplete -> fail 2026-03-09 15:56:37,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:37,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeed3dfeb96b28aa34c400 HTTP/1.1" 200 None 2026-03-09 15:56:37,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:37,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:56:37,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:56:37,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeed3dfeb96b28aa34c400 HTTP/1.1" 200 None 2026-03-09 15:56:37,353 - lava_callback - INFO - Completed processing callback for node 69aeed3dfeb96b28aa34c400 INFO: 172.20.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48488 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:57:01,396 - lava_callback - INFO - Received callback for node 69ac4aba40deb775998f619f INFO: 172.20.0.1:42194 - "POST /node/69ac4aba40deb775998f619f HTTP/1.0" 202 Accepted 2026-03-09 15:57:01,401 - lava_callback - INFO - Starting async job submit for node 69ac4aba40deb775998f619f 2026-03-09 15:57:01,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:01,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4aba40deb775998f619f HTTP/1.1" 200 None 2026-03-09 15:57:01,418 - lava_callback - DEBUG - Processing node 69ac4aba40deb775998f619f: baseline-arm64-baylibre 2026-03-09 15:57:01,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac4aba40deb775998f619f 2026-03-09 15:57:01,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:01,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4aba40deb775998f619f HTTP/1.1" 200 None 2026-03-09 15:57:01,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:01,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-09 15:57:01,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:01,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac4aba40deb775998f619f HTTP/1.1" 200 None 2026-03-09 15:57:01,480 - lava_callback - ERROR - Error processing callback for node 69ac4aba40deb775998f619f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-09 15:57:05,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:05,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40428 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:57:22,638 - lava_callback - INFO - Received callback for node 69aeed85feb96b28aa34c40d INFO: 172.20.0.1:40642 - "POST /node/69aeed85feb96b28aa34c40d HTTP/1.0" 202 Accepted 2026-03-09 15:57:22,645 - lava_callback - INFO - Starting async job submit for node 69aeed85feb96b28aa34c40d 2026-03-09 15:57:22,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:22,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeed85feb96b28aa34c40d HTTP/1.1" 200 None 2026-03-09 15:57:22,697 - lava_callback - DEBUG - Processing node 69aeed85feb96b28aa34c40d: baseline-arm64 2026-03-09 15:57:23,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:57:23,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:57:23,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeed85feb96b28aa34c40d/log.txt.gz 2026-03-09 15:57:23,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:57:23,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:57:23,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeed85feb96b28aa34c40d/lava-logs.yaml 2026-03-09 15:57:23,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:57:23,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:57:23,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeed85feb96b28aa34c40d/lava_callback.json.gz DEBUG: Setup failed for 69aeed85feb96b28aa34c40d. Transitting job node result: incomplete -> fail 2026-03-09 15:57:23,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:23,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeed85feb96b28aa34c40d HTTP/1.1" 200 None 2026-03-09 15:57:23,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:23,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:57:23,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:23,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeed85feb96b28aa34c40d HTTP/1.1" 200 None 2026-03-09 15:57:24,076 - lava_callback - INFO - Completed processing callback for node 69aeed85feb96b28aa34c40d INFO: 172.20.0.1:40652 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:57:35,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:57:35,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57758 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:58:01,386 - lava_callback - INFO - Received callback for node 69ac4b0440deb775998f61af INFO: 172.20.0.1:58910 - "POST /node/69ac4b0440deb775998f61af HTTP/1.0" 202 Accepted 2026-03-09 15:58:01,392 - lava_callback - INFO - Starting async job submit for node 69ac4b0440deb775998f61af 2026-03-09 15:58:01,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:01,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4b0440deb775998f61af HTTP/1.1" 200 None 2026-03-09 15:58:01,417 - lava_callback - DEBUG - Processing node 69ac4b0440deb775998f61af: baseline-arm64-baylibre 2026-03-09 15:58:01,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac4b0440deb775998f61af 2026-03-09 15:58:01,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:01,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4b0440deb775998f61af HTTP/1.1" 200 None 2026-03-09 15:58:01,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:01,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-09 15:58:01,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:01,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac4b0440deb775998f61af HTTP/1.1" 200 None 2026-03-09 15:58:01,485 - lava_callback - ERROR - Error processing callback for node 69ac4b0440deb775998f61af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:58:51,178 - lava_callback - INFO - Received callback for node 69aeedd9feb96b28aa34c424 INFO: 172.20.0.1:60884 - "POST /node/69aeedd9feb96b28aa34c424 HTTP/1.0" 202 Accepted 2026-03-09 15:58:51,184 - lava_callback - INFO - Starting async job submit for node 69aeedd9feb96b28aa34c424 2026-03-09 15:58:51,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:51,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeedd9feb96b28aa34c424 HTTP/1.1" 200 None 2026-03-09 15:58:51,232 - lava_callback - DEBUG - Processing node 69aeedd9feb96b28aa34c424: baseline-nfs-arm64 2026-03-09 15:58:51,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:58:51,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:58:51,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeedd9feb96b28aa34c424/log.txt.gz 2026-03-09 15:58:52,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:58:52,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:58:52,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeedd9feb96b28aa34c424/lava-logs.yaml 2026-03-09 15:58:52,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 15:58:52,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 15:58:52,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeedd9feb96b28aa34c424/lava_callback.json.gz DEBUG: Setup failed for 69aeedd9feb96b28aa34c424. Transitting job node result: incomplete -> fail 2026-03-09 15:58:52,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:52,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeedd9feb96b28aa34c424 HTTP/1.1" 200 None 2026-03-09 15:58:52,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:52,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 15:58:52,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:58:52,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeedd9feb96b28aa34c424 HTTP/1.1" 200 None 2026-03-09 15:58:52,704 - lava_callback - INFO - Completed processing callback for node 69aeedd9feb96b28aa34c424 INFO: 172.20.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60902 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:59:05,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:59:05,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55552 - "GET / HTTP/1.0" 200 OK 2026-03-09 15:59:21,537 - lava_callback - INFO - Received callback for node 69ac4b4d40deb775998f61c6 INFO: 172.20.0.1:47182 - "POST /node/69ac4b4d40deb775998f61c6 HTTP/1.0" 202 Accepted 2026-03-09 15:59:21,543 - lava_callback - INFO - Starting async job submit for node 69ac4b4d40deb775998f61c6 2026-03-09 15:59:21,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:59:21,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4b4d40deb775998f61c6 HTTP/1.1" 200 None 2026-03-09 15:59:21,561 - lava_callback - DEBUG - Processing node 69ac4b4d40deb775998f61c6: baseline-arm64-baylibre 2026-03-09 15:59:21,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac4b4d40deb775998f61c6 2026-03-09 15:59:21,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:59:21,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4b4d40deb775998f61c6 HTTP/1.1" 200 None 2026-03-09 15:59:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:59:21,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-09 15:59:21,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 15:59:21,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac4b4d40deb775998f61c6 HTTP/1.1" 200 None 2026-03-09 15:59:21,620 - lava_callback - ERROR - Error processing callback for node 69ac4b4d40deb775998f61c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44976 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:00:41,583 - lava_callback - INFO - Received callback for node 69ac4b9840deb775998f61d6 INFO: 172.20.0.1:39754 - "POST /node/69ac4b9840deb775998f61d6 HTTP/1.0" 202 Accepted 2026-03-09 16:00:41,588 - lava_callback - INFO - Starting async job submit for node 69ac4b9840deb775998f61d6 2026-03-09 16:00:41,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:00:41,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4b9840deb775998f61d6 HTTP/1.1" 200 None 2026-03-09 16:00:41,604 - lava_callback - DEBUG - Processing node 69ac4b9840deb775998f61d6: baseline-arm64-baylibre 2026-03-09 16:00:41,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ac4b9840deb775998f61d6 2026-03-09 16:00:41,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:00:41,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac4b9840deb775998f61d6 HTTP/1.1" 200 None 2026-03-09 16:00:41,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:00:41,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-09 16:00:41,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:00:41,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac4b9840deb775998f61d6 HTTP/1.1" 200 None 2026-03-09 16:00:41,670 - lava_callback - ERROR - Error processing callback for node 69ac4b9840deb775998f61d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35324 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:01:40,541 - lava_callback - INFO - Received callback for node 69aeee75feb96b28aa34c442 INFO: 172.20.0.1:55318 - "POST /node/69aeee75feb96b28aa34c442 HTTP/1.0" 202 Accepted 2026-03-09 16:01:40,548 - lava_callback - INFO - Starting async job submit for node 69aeee75feb96b28aa34c442 2026-03-09 16:01:40,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:01:40,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeee75feb96b28aa34c442 HTTP/1.1" 200 None 2026-03-09 16:01:40,610 - lava_callback - DEBUG - Processing node 69aeee75feb96b28aa34c442: baseline-nfs-arm64 2026-03-09 16:01:41,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:01:41,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:01:41,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeee75feb96b28aa34c442/log.txt.gz 2026-03-09 16:01:41,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:01:41,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:01:41,885 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeee75feb96b28aa34c442/lava-logs.yaml 2026-03-09 16:01:41,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:01:42,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:01:42,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeee75feb96b28aa34c442/lava_callback.json.gz DEBUG: Setup failed for 69aeee75feb96b28aa34c442. Transitting job node result: incomplete -> fail 2026-03-09 16:01:42,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:01:42,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeee75feb96b28aa34c442 HTTP/1.1" 200 None 2026-03-09 16:01:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:01:42,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:01:42,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:01:42,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeee75feb96b28aa34c442 HTTP/1.1" 200 None 2026-03-09 16:01:42,276 - lava_callback - INFO - Completed processing callback for node 69aeee75feb96b28aa34c442 INFO: 172.20.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58638 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:02:05,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:05,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35934 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:02:09,091 - lava_callback - INFO - Received callback for node 69aeee26feb96b28aa34c432 INFO: 172.20.0.1:35940 - "POST /node/69aeee26feb96b28aa34c432 HTTP/1.0" 202 Accepted 2026-03-09 16:02:09,098 - lava_callback - INFO - Starting async job submit for node 69aeee26feb96b28aa34c432 2026-03-09 16:02:09,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:09,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeee26feb96b28aa34c432 HTTP/1.1" 200 None 2026-03-09 16:02:09,145 - lava_callback - DEBUG - Processing node 69aeee26feb96b28aa34c432: baseline-nfs-arm64 2026-03-09 16:02:09,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:02:09,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:02:09,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeee26feb96b28aa34c432/log.txt.gz 2026-03-09 16:02:09,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:02:10,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:02:10,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeee26feb96b28aa34c432/lava-logs.yaml 2026-03-09 16:02:10,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:02:10,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:02:10,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeee26feb96b28aa34c432/lava_callback.json.gz DEBUG: Setup failed for 69aeee26feb96b28aa34c432. Transitting job node result: incomplete -> fail 2026-03-09 16:02:10,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:10,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeee26feb96b28aa34c432 HTTP/1.1" 200 None 2026-03-09 16:02:10,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:10,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:02:10,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:10,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeee26feb96b28aa34c432 HTTP/1.1" 200 None 2026-03-09 16:02:10,580 - lava_callback - INFO - Completed processing callback for node 69aeee26feb96b28aa34c432 INFO: 172.20.0.1:40988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49952 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:02:35,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:35,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:02:42,609 - lava_callback - INFO - Received callback for node 69aeeebefeb96b28aa34c44d INFO: 172.20.0.1:46096 - "POST /node/69aeeebefeb96b28aa34c44d HTTP/1.0" 202 Accepted 2026-03-09 16:02:42,616 - lava_callback - INFO - Starting async job submit for node 69aeeebefeb96b28aa34c44d 2026-03-09 16:02:42,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:42,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeebefeb96b28aa34c44d HTTP/1.1" 200 None 2026-03-09 16:02:42,664 - lava_callback - DEBUG - Processing node 69aeeebefeb96b28aa34c44d: baseline-arm64 2026-03-09 16:02:43,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:02:43,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:02:43,630 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeebefeb96b28aa34c44d/log.txt.gz 2026-03-09 16:02:44,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:02:44,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:02:44,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeebefeb96b28aa34c44d/lava-logs.yaml 2026-03-09 16:02:44,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:02:44,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:02:44,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeebefeb96b28aa34c44d/lava_callback.json.gz DEBUG: Setup failed for 69aeeebefeb96b28aa34c44d. Transitting job node result: incomplete -> fail 2026-03-09 16:02:44,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:44,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeebefeb96b28aa34c44d HTTP/1.1" 200 None 2026-03-09 16:02:44,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:44,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:02:44,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:02:44,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeeebefeb96b28aa34c44d HTTP/1.1" 200 None 2026-03-09 16:02:44,734 - lava_callback - INFO - Completed processing callback for node 69aeeebefeb96b28aa34c44d INFO: 172.20.0.1:46108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:03:05,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:03:05,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:04:11,615 - lava_callback - INFO - Received callback for node 69aeef13feb96b28aa34c460 INFO: 172.20.0.1:60794 - "POST /node/69aeef13feb96b28aa34c460 HTTP/1.0" 202 Accepted 2026-03-09 16:04:11,622 - lava_callback - INFO - Starting async job submit for node 69aeef13feb96b28aa34c460 2026-03-09 16:04:11,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:04:11,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeef13feb96b28aa34c460 HTTP/1.1" 200 None 2026-03-09 16:04:11,669 - lava_callback - DEBUG - Processing node 69aeef13feb96b28aa34c460: baseline-nfs-arm64 2026-03-09 16:04:12,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:04:12,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:04:12,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeef13feb96b28aa34c460/log.txt.gz 2026-03-09 16:04:13,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:04:13,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:04:13,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeef13feb96b28aa34c460/lava-logs.yaml 2026-03-09 16:04:13,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:04:13,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:04:13,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69aeef13feb96b28aa34c460/lava_callback.json.gz DEBUG: Setup failed for 69aeef13feb96b28aa34c460. Transitting job node result: incomplete -> fail 2026-03-09 16:04:13,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:04:13,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeef13feb96b28aa34c460 HTTP/1.1" 200 None 2026-03-09 16:04:13,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:04:13,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:04:13,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:04:13,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeef13feb96b28aa34c460 HTTP/1.1" 200 None 2026-03-09 16:04:13,775 - lava_callback - INFO - Completed processing callback for node 69aeef13feb96b28aa34c460 INFO: 172.20.0.1:60800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53476 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:04:35,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:04:35,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45318 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:06:20,609 - lava_callback - INFO - Received callback for node 69aee996feb96b28aa34c344 INFO: 172.20.0.1:59200 - "POST /node/69aee996feb96b28aa34c344 HTTP/1.0" 202 Accepted 2026-03-09 16:06:20,615 - lava_callback - INFO - Starting async job submit for node 69aee996feb96b28aa34c344 2026-03-09 16:06:20,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:20,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee996feb96b28aa34c344 HTTP/1.1" 200 None 2026-03-09 16:06:20,670 - lava_callback - DEBUG - Processing node 69aee996feb96b28aa34c344: baseline-arm64-broonie 2026-03-09 16:06:20,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:06:21,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:06:21,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee996feb96b28aa34c344/log.txt.gz 2026-03-09 16:06:21,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:06:21,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:06:21,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee996feb96b28aa34c344/lava-logs.yaml 2026-03-09 16:06:21,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:06:21,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:06:21,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aee996feb96b28aa34c344/lava_callback.json.gz DEBUG: Setup failed for 69aee996feb96b28aa34c344. Transitting job node result: incomplete -> fail 2026-03-09 16:06:21,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:21,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aee996feb96b28aa34c344 HTTP/1.1" 200 None 2026-03-09 16:06:21,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:21,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:06:21,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:21,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aee996feb96b28aa34c344 HTTP/1.1" 200 None 2026-03-09 16:06:21,842 - lava_callback - INFO - Completed processing callback for node 69aee996feb96b28aa34c344 INFO: 172.20.0.1:59204 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:06:31,679 - lava_callback - INFO - Received callback for node 69aeeff4feb96b28aa34c48d INFO: 172.20.0.1:34242 - "POST /node/69aeeff4feb96b28aa34c48d HTTP/1.0" 202 Accepted 2026-03-09 16:06:31,684 - lava_callback - INFO - Starting async job submit for node 69aeeff4feb96b28aa34c48d 2026-03-09 16:06:31,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:31,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeff4feb96b28aa34c48d HTTP/1.1" 200 None 2026-03-09 16:06:31,703 - lava_callback - DEBUG - Processing node 69aeeff4feb96b28aa34c48d: baseline-arm64 2026-03-09 16:06:31,708 - lava_callback - WARNING - Failed to upload log 2026-03-09 16:06:31,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:06:31,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:06:31,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeff4feb96b28aa34c48d/lava-logs.yaml 2026-03-09 16:06:31,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:06:31,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:06:31,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeeff4feb96b28aa34c48d/lava_callback.json.gz 2026-03-09 16:06:31,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:31,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeff4feb96b28aa34c48d HTTP/1.1" 200 None 2026-03-09 16:06:31,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:31,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:06:31,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:32,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeeff4feb96b28aa34c48d HTTP/1.1" 200 None 2026-03-09 16:06:32,022 - lava_callback - INFO - Completed processing callback for node 69aeeff4feb96b28aa34c48d 2026-03-09 16:06:35,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:06:35,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:11:03,460 - lava_callback - INFO - Received callback for node 69aeefb7feb96b28aa34c486 INFO: 172.20.0.1:58890 - "POST /node/69aeefb7feb96b28aa34c486 HTTP/1.0" 202 Accepted 2026-03-09 16:11:03,466 - lava_callback - INFO - Starting async job submit for node 69aeefb7feb96b28aa34c486 2026-03-09 16:11:03,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:11:03,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeefb7feb96b28aa34c486 HTTP/1.1" 200 None 2026-03-09 16:11:03,522 - lava_callback - DEBUG - Processing node 69aeefb7feb96b28aa34c486: baseline-arm64-broonie 2026-03-09 16:11:03,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:11:03,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:11:03,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aeefb7feb96b28aa34c486/log.txt.gz 2026-03-09 16:11:04,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:11:04,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:11:04,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aeefb7feb96b28aa34c486/lava-logs.yaml 2026-03-09 16:11:04,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:11:04,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:11:04,480 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aeefb7feb96b28aa34c486/lava_callback.json.gz DEBUG: Setup failed for 69aeefb7feb96b28aa34c486. Transitting job node result: incomplete -> fail 2026-03-09 16:11:04,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:11:04,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeefb7feb96b28aa34c486 HTTP/1.1" 200 None 2026-03-09 16:11:04,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:11:04,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:11:04,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:11:04,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeefb7feb96b28aa34c486 HTTP/1.1" 200 None 2026-03-09 16:11:04,683 - lava_callback - INFO - Completed processing callback for node 69aeefb7feb96b28aa34c486 2026-03-09 16:11:05,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:11:05,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52106 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:12:28,719 - lava_callback - INFO - Received callback for node 69aef15ffeb96b28aa34c4cd INFO: 172.20.0.1:52112 - "POST /node/69aef15ffeb96b28aa34c4cd HTTP/1.0" 202 Accepted 2026-03-09 16:12:28,725 - lava_callback - INFO - Starting async job submit for node 69aef15ffeb96b28aa34c4cd 2026-03-09 16:12:28,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:12:28,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef15ffeb96b28aa34c4cd HTTP/1.1" 200 None 2026-03-09 16:12:28,743 - lava_callback - DEBUG - Processing node 69aef15ffeb96b28aa34c4cd: baseline-arm64 2026-03-09 16:12:28,747 - lava_callback - WARNING - Failed to upload log 2026-03-09 16:12:28,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:12:28,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:12:28,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aef15ffeb96b28aa34c4cd/lava-logs.yaml 2026-03-09 16:12:28,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:12:29,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:12:29,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aef15ffeb96b28aa34c4cd/lava_callback.json.gz 2026-03-09 16:12:29,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:12:29,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef15ffeb96b28aa34c4cd HTTP/1.1" 200 None 2026-03-09 16:12:29,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:12:29,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:12:29,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:12:29,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef15ffeb96b28aa34c4cd HTTP/1.1" 200 None 2026-03-09 16:12:29,158 - lava_callback - INFO - Completed processing callback for node 69aef15ffeb96b28aa34c4cd 2026-03-09 16:12:35,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:12:35,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59514 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:13:40,734 - lava_callback - INFO - Received callback for node 69aec8a6feb96b28aa34b728 INFO: 172.20.0.1:54550 - "POST /node/69aec8a6feb96b28aa34b728 HTTP/1.0" 202 Accepted 2026-03-09 16:13:40,740 - lava_callback - INFO - Starting async job submit for node 69aec8a6feb96b28aa34b728 2026-03-09 16:13:40,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:13:40,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a6feb96b28aa34b728 HTTP/1.1" 200 None 2026-03-09 16:13:40,775 - lava_callback - DEBUG - Processing node 69aec8a6feb96b28aa34b728: baseline-arm64-broonie 2026-03-09 16:13:41,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:13:41,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:13:41,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a6feb96b28aa34b728/log.txt.gz 2026-03-09 16:13:41,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:13:41,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:13:41,713 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a6feb96b28aa34b728/lava-logs.yaml 2026-03-09 16:13:41,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:13:41,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:13:41,859 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aec8a6feb96b28aa34b728/lava_callback.json.gz 2026-03-09 16:13:41,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:13:41,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aec8a6feb96b28aa34b728 HTTP/1.1" 200 None 2026-03-09 16:13:41,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:13:41,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:13:41,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:13:41,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aec8a6feb96b28aa34b728 HTTP/1.1" 200 None 2026-03-09 16:13:42,018 - lava_callback - INFO - Completed processing callback for node 69aec8a6feb96b28aa34b728 INFO: 172.20.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39892 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:14:05,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:14:06,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34242 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:14:59,095 - lava_callback - INFO - Received callback for node 69aeef5bfeb96b28aa34c472 INFO: 172.20.0.1:34250 - "POST /node/69aeef5bfeb96b28aa34c472 HTTP/1.0" 202 Accepted 2026-03-09 16:14:59,102 - lava_callback - INFO - Starting async job submit for node 69aeef5bfeb96b28aa34c472 2026-03-09 16:14:59,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:14:59,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeef5bfeb96b28aa34c472 HTTP/1.1" 200 None 2026-03-09 16:14:59,151 - lava_callback - DEBUG - Processing node 69aeef5bfeb96b28aa34c472: baseline-arm64 2026-03-09 16:14:59,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:14:59,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:14:59,576 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeef5bfeb96b28aa34c472/log.txt.gz 2026-03-09 16:14:59,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:14:59,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:14:59,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeef5bfeb96b28aa34c472/lava-logs.yaml 2026-03-09 16:14:59,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:15:00,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:15:00,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69aeef5bfeb96b28aa34c472/lava_callback.json.gz 2026-03-09 16:15:00,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:15:00,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeef5bfeb96b28aa34c472 HTTP/1.1" 200 None 2026-03-09 16:15:00,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:15:00,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:15:00,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:15:00,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeef5bfeb96b28aa34c472 HTTP/1.1" 200 None 2026-03-09 16:15:00,279 - lava_callback - INFO - Completed processing callback for node 69aeef5bfeb96b28aa34c472 2026-03-09 16:15:06,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:15:06,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33496 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:16:20,676 - lava_callback - INFO - Received callback for node 69aef123feb96b28aa34c4c6 INFO: 172.20.0.1:48696 - "POST /node/69aef123feb96b28aa34c4c6 HTTP/1.0" 202 Accepted 2026-03-09 16:16:20,682 - lava_callback - INFO - Starting async job submit for node 69aef123feb96b28aa34c4c6 2026-03-09 16:16:20,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:16:20,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef123feb96b28aa34c4c6 HTTP/1.1" 200 None 2026-03-09 16:16:20,732 - lava_callback - DEBUG - Processing node 69aef123feb96b28aa34c4c6: baseline-arm64-broonie 2026-03-09 16:16:21,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:16:21,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:16:21,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aef123feb96b28aa34c4c6/log.txt.gz 2026-03-09 16:16:21,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:16:21,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:16:21,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aef123feb96b28aa34c4c6/lava-logs.yaml 2026-03-09 16:16:21,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:16:21,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:16:21,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69aef123feb96b28aa34c4c6/lava_callback.json.gz DEBUG: Setup failed for 69aef123feb96b28aa34c4c6. Transitting job node result: incomplete -> fail 2026-03-09 16:16:21,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:16:21,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aef123feb96b28aa34c4c6 HTTP/1.1" 200 None 2026-03-09 16:16:21,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:16:21,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba41feb96b28aa34a78b HTTP/1.1" 200 None 2026-03-09 16:16:21,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:16:21,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aef123feb96b28aa34c4c6 HTTP/1.1" 200 None 2026-03-09 16:16:21,928 - lava_callback - INFO - Completed processing callback for node 69aef123feb96b28aa34c4c6 INFO: 172.20.0.1:48702 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:16:36,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:16:36,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49074 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:18:42,594 - lava_callback - INFO - Received callback for node 69aeeebafeb96b28aa34c44a INFO: 172.20.0.1:49296 - "POST /node/69aeeebafeb96b28aa34c44a HTTP/1.0" 202 Accepted 2026-03-09 16:18:42,605 - lava_callback - INFO - Starting async job submit for node 69aeeebafeb96b28aa34c44a 2026-03-09 16:18:42,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:18:42,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeebafeb96b28aa34c44a HTTP/1.1" 200 None 2026-03-09 16:18:42,742 - lava_callback - DEBUG - Processing node 69aeeebafeb96b28aa34c44a: ltp-smoke 2026-03-09 16:18:43,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:18:43,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:18:43,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69aeeebafeb96b28aa34c44a/log.txt.gz 2026-03-09 16:18:44,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:18:44,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:18:44,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69aeeebafeb96b28aa34c44a/lava-logs.yaml 2026-03-09 16:18:44,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-09 16:18:44,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-09 16:18:44,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69aeeebafeb96b28aa34c44a/lava_callback.json.gz 2026-03-09 16:18:44,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:18:44,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeeebafeb96b28aa34c44a HTTP/1.1" 200 None 2026-03-09 16:18:44,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:18:44,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69aeba38feb96b28aa34a77b HTTP/1.1" 200 None 2026-03-09 16:18:44,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:18:44,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69aeeebafeb96b28aa34c44a HTTP/1.1" 200 None 2026-03-09 16:18:45,023 - lava_callback - INFO - Completed processing callback for node 69aeeebafeb96b28aa34c44a INFO: 172.20.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34830 - "GET / HTTP/1.0" 200 OK 2026-03-09 16:19:06,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-09 16:19:06,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]