INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60172 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:32:26,107 - lava_callback - INFO - Received callback for node 69f8c9960573a8210e12cf82 2026-05-04 16:32:26,114 - lava_callback - INFO - Starting async job submit for node 69f8c9960573a8210e12cf82 INFO: 172.20.0.1:60174 - "POST /node/69f8c9960573a8210e12cf82 HTTP/1.0" 202 Accepted 2026-05-04 16:32:26,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:32:26,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9960573a8210e12cf82 HTTP/1.1" 200 None 2026-05-04 16:32:26,157 - lava_callback - DEBUG - Processing node 69f8c9960573a8210e12cf82: baseline-arm 2026-05-04 16:32:26,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60180 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:32:26,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:32:26,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8c9960573a8210e12cf82/log.txt.gz 2026-05-04 16:32:26,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:32:26,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:32:26,810 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8c9960573a8210e12cf82/lava-logs.yaml 2026-05-04 16:32:26,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:32:26,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:32:26,947 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8c9960573a8210e12cf82/lava_callback.json.gz 2026-05-04 16:32:26,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:32:26,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9960573a8210e12cf82 HTTP/1.1" 200 None 2026-05-04 16:32:26,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:32:26,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c66b0573a8210e12ccc7 HTTP/1.1" 200 None 2026-05-04 16:32:26,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:32:27,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c9960573a8210e12cf82 HTTP/1.1" 200 None 2026-05-04 16:32:27,023 - lava_callback - INFO - Completed processing callback for node 69f8c9960573a8210e12cf82 INFO: 172.20.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53184 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:32:57,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:32:57,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46696 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:41:59,462 - lava_callback - INFO - Received callback for node 69f6294d8234569b79a1e81e INFO: 172.20.0.1:46702 - "POST /node/69f6294d8234569b79a1e81e HTTP/1.0" 202 Accepted 2026-05-04 16:41:59,467 - lava_callback - INFO - Starting async job submit for node 69f6294d8234569b79a1e81e 2026-05-04 16:41:59,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:41:59,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6294d8234569b79a1e81e HTTP/1.1" 200 None 2026-05-04 16:41:59,484 - lava_callback - DEBUG - Processing node 69f6294d8234569b79a1e81e: baseline-arm-baylibre 2026-05-04 16:41:59,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6294d8234569b79a1e81e 2026-05-04 16:41:59,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:41:59,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6294d8234569b79a1e81e HTTP/1.1" 200 None 2026-05-04 16:41:59,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:41:59,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:41:59,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:41:59,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6294d8234569b79a1e81e HTTP/1.1" 200 None 2026-05-04 16:41:59,546 - lava_callback - ERROR - Error processing callback for node 69f6294d8234569b79a1e81e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:00,121 - lava_callback - INFO - Received callback for node 69f6294e8234569b79a1e821 INFO: 172.20.0.1:34236 - "POST /node/69f6294e8234569b79a1e821 HTTP/1.0" 202 Accepted 2026-05-04 16:42:00,127 - lava_callback - INFO - Starting async job submit for node 69f6294e8234569b79a1e821 2026-05-04 16:42:00,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6294e8234569b79a1e821 HTTP/1.1" 200 None 2026-05-04 16:42:00,143 - lava_callback - DEBUG - Processing node 69f6294e8234569b79a1e821: baseline-arm-baylibre 2026-05-04 16:42:00,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6294e8234569b79a1e821 2026-05-04 16:42:00,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6294e8234569b79a1e821 HTTP/1.1" 200 None 2026-05-04 16:42:00,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:00,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6294e8234569b79a1e821 HTTP/1.1" 200 None 2026-05-04 16:42:00,193 - lava_callback - ERROR - Error processing callback for node 69f6294e8234569b79a1e821: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:00,812 - lava_callback - INFO - Received callback for node 69f629508234569b79a1e824 INFO: 172.20.0.1:34252 - "POST /node/69f629508234569b79a1e824 HTTP/1.0" 202 Accepted 2026-05-04 16:42:00,817 - lava_callback - INFO - Starting async job submit for node 69f629508234569b79a1e824 2026-05-04 16:42:00,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629508234569b79a1e824 HTTP/1.1" 200 None 2026-05-04 16:42:00,848 - lava_callback - DEBUG - Processing node 69f629508234569b79a1e824: baseline-arm-baylibre 2026-05-04 16:42:00,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f629508234569b79a1e824 2026-05-04 16:42:00,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629508234569b79a1e824 HTTP/1.1" 200 None 2026-05-04 16:42:00,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:00,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:00,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f629508234569b79a1e824 HTTP/1.1" 200 None 2026-05-04 16:42:00,900 - lava_callback - ERROR - Error processing callback for node 69f629508234569b79a1e824: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:01,458 - lava_callback - INFO - Received callback for node 69f629518234569b79a1e827 INFO: 172.20.0.1:34268 - "POST /node/69f629518234569b79a1e827 HTTP/1.0" 202 Accepted 2026-05-04 16:42:01,463 - lava_callback - INFO - Starting async job submit for node 69f629518234569b79a1e827 2026-05-04 16:42:01,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:01,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629518234569b79a1e827 HTTP/1.1" 200 None 2026-05-04 16:42:01,479 - lava_callback - DEBUG - Processing node 69f629518234569b79a1e827: baseline-arm-baylibre 2026-05-04 16:42:01,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f629518234569b79a1e827 2026-05-04 16:42:01,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:01,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629518234569b79a1e827 HTTP/1.1" 200 None 2026-05-04 16:42:01,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:01,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:01,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:01,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f629518234569b79a1e827 HTTP/1.1" 200 None 2026-05-04 16:42:01,523 - lava_callback - ERROR - Error processing callback for node 69f629518234569b79a1e827: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:02,147 - lava_callback - INFO - Received callback for node 69f629538234569b79a1e838 INFO: 172.20.0.1:34282 - "POST /node/69f629538234569b79a1e838 HTTP/1.0" 202 Accepted 2026-05-04 16:42:02,153 - lava_callback - INFO - Starting async job submit for node 69f629538234569b79a1e838 2026-05-04 16:42:02,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629538234569b79a1e838 HTTP/1.1" 200 None 2026-05-04 16:42:02,175 - lava_callback - DEBUG - Processing node 69f629538234569b79a1e838: baseline-arm-baylibre 2026-05-04 16:42:02,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f629538234569b79a1e838 2026-05-04 16:42:02,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629538234569b79a1e838 HTTP/1.1" 200 None 2026-05-04 16:42:02,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:02,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f629538234569b79a1e838 HTTP/1.1" 200 None 2026-05-04 16:42:02,220 - lava_callback - ERROR - Error processing callback for node 69f629538234569b79a1e838: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:02,820 - lava_callback - INFO - Received callback for node 69f629558234569b79a1e83b INFO: 172.20.0.1:34296 - "POST /node/69f629558234569b79a1e83b HTTP/1.0" 202 Accepted 2026-05-04 16:42:02,826 - lava_callback - INFO - Starting async job submit for node 69f629558234569b79a1e83b 2026-05-04 16:42:02,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629558234569b79a1e83b HTTP/1.1" 200 None 2026-05-04 16:42:02,841 - lava_callback - DEBUG - Processing node 69f629558234569b79a1e83b: baseline-arm-baylibre 2026-05-04 16:42:02,841 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f629558234569b79a1e83b 2026-05-04 16:42:02,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629558234569b79a1e83b HTTP/1.1" 200 None 2026-05-04 16:42:02,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:02,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:02,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f629558234569b79a1e83b HTTP/1.1" 200 None 2026-05-04 16:42:02,898 - lava_callback - ERROR - Error processing callback for node 69f629558234569b79a1e83b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42192 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:42:24,500 - lava_callback - INFO - Received callback for node 69f6295c8234569b79a1e86a INFO: 172.20.0.1:42196 - "POST /node/69f6295c8234569b79a1e86a HTTP/1.0" 202 Accepted 2026-05-04 16:42:24,506 - lava_callback - INFO - Starting async job submit for node 69f6295c8234569b79a1e86a 2026-05-04 16:42:24,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:24,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6295c8234569b79a1e86a HTTP/1.1" 200 None 2026-05-04 16:42:24,546 - lava_callback - DEBUG - Processing node 69f6295c8234569b79a1e86a: baseline-arm-clabbe 2026-05-04 16:42:24,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6295c8234569b79a1e86a 2026-05-04 16:42:24,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:24,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6295c8234569b79a1e86a HTTP/1.1" 200 None 2026-05-04 16:42:24,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:24,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:24,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:24,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6295c8234569b79a1e86a HTTP/1.1" 200 None 2026-05-04 16:42:24,630 - lava_callback - ERROR - Error processing callback for node 69f6295c8234569b79a1e86a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:25,186 - lava_callback - INFO - Received callback for node 69f6295f8234569b79a1e877 INFO: 172.20.0.1:42200 - "POST /node/69f6295f8234569b79a1e877 HTTP/1.0" 202 Accepted 2026-05-04 16:42:25,191 - lava_callback - INFO - Starting async job submit for node 69f6295f8234569b79a1e877 2026-05-04 16:42:25,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6295f8234569b79a1e877 HTTP/1.1" 200 None 2026-05-04 16:42:25,206 - lava_callback - DEBUG - Processing node 69f6295f8234569b79a1e877: baseline-arm-clabbe 2026-05-04 16:42:25,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6295f8234569b79a1e877 2026-05-04 16:42:25,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6295f8234569b79a1e877 HTTP/1.1" 200 None 2026-05-04 16:42:25,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:25,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6295f8234569b79a1e877 HTTP/1.1" 200 None 2026-05-04 16:42:25,255 - lava_callback - ERROR - Error processing callback for node 69f6295f8234569b79a1e877: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:25,875 - lava_callback - INFO - Received callback for node 69f629608234569b79a1e87a INFO: 172.20.0.1:42216 - "POST /node/69f629608234569b79a1e87a HTTP/1.0" 202 Accepted 2026-05-04 16:42:25,880 - lava_callback - INFO - Starting async job submit for node 69f629608234569b79a1e87a 2026-05-04 16:42:25,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629608234569b79a1e87a HTTP/1.1" 200 None 2026-05-04 16:42:25,896 - lava_callback - DEBUG - Processing node 69f629608234569b79a1e87a: baseline-arm-clabbe 2026-05-04 16:42:25,896 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f629608234569b79a1e87a 2026-05-04 16:42:25,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629608234569b79a1e87a HTTP/1.1" 200 None 2026-05-04 16:42:25,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:25,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:25,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f629608234569b79a1e87a HTTP/1.1" 200 None 2026-05-04 16:42:25,942 - lava_callback - ERROR - Error processing callback for node 69f629608234569b79a1e87a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42222 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:42:26,533 - lava_callback - INFO - Received callback for node 69f629618234569b79a1e87d INFO: 172.20.0.1:42232 - "POST /node/69f629618234569b79a1e87d HTTP/1.0" 202 Accepted 2026-05-04 16:42:26,539 - lava_callback - INFO - Starting async job submit for node 69f629618234569b79a1e87d 2026-05-04 16:42:26,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:26,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629618234569b79a1e87d HTTP/1.1" 200 None 2026-05-04 16:42:26,554 - lava_callback - DEBUG - Processing node 69f629618234569b79a1e87d: baseline-arm-clabbe 2026-05-04 16:42:26,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f629618234569b79a1e87d 2026-05-04 16:42:26,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:26,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629618234569b79a1e87d HTTP/1.1" 200 None 2026-05-04 16:42:26,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:26,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:26,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:26,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f629618234569b79a1e87d HTTP/1.1" 200 None 2026-05-04 16:42:26,607 - lava_callback - ERROR - Error processing callback for node 69f629618234569b79a1e87d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:42:27,198 - lava_callback - INFO - Received callback for node 69f629638234569b79a1e88a INFO: 172.20.0.1:42234 - "POST /node/69f629638234569b79a1e88a HTTP/1.0" 202 Accepted 2026-05-04 16:42:27,203 - lava_callback - INFO - Starting async job submit for node 69f629638234569b79a1e88a 2026-05-04 16:42:27,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:27,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629638234569b79a1e88a HTTP/1.1" 200 None 2026-05-04 16:42:27,220 - lava_callback - DEBUG - Processing node 69f629638234569b79a1e88a: baseline-arm-clabbe 2026-05-04 16:42:27,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f629638234569b79a1e88a 2026-05-04 16:42:27,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:27,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f629638234569b79a1e88a HTTP/1.1" 200 None 2026-05-04 16:42:27,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:27,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 16:42:27,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:42:27,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f629638234569b79a1e88a HTTP/1.1" 200 None 2026-05-04 16:42:27,268 - lava_callback - ERROR - Error processing callback for node 69f629638234569b79a1e88a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44426 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:47:43,145 - lava_callback - INFO - Received callback for node 69f8cda70573a8210e12fac5 INFO: 172.20.0.1:53906 - "POST /node/69f8cda70573a8210e12fac5 HTTP/1.0" 202 Accepted 2026-05-04 16:47:43,151 - lava_callback - INFO - Starting async job submit for node 69f8cda70573a8210e12fac5 2026-05-04 16:47:43,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:47:43,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda70573a8210e12fac5 HTTP/1.1" 200 None 2026-05-04 16:47:43,171 - lava_callback - DEBUG - Processing node 69f8cda70573a8210e12fac5: baseline-arm 2026-05-04 16:47:43,183 - lava_callback - WARNING - Failed to upload log 2026-05-04 16:47:43,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:47:43,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:47:43,312 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda70573a8210e12fac5/lava-logs.yaml 2026-05-04 16:47:43,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:47:43,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:47:43,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda70573a8210e12fac5/lava_callback.json.gz 2026-05-04 16:47:43,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:47:43,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda70573a8210e12fac5 HTTP/1.1" 200 None 2026-05-04 16:47:43,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:47:43,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:47:43,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:47:43,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cda70573a8210e12fac5 HTTP/1.1" 200 None 2026-05-04 16:47:43,447 - lava_callback - INFO - Completed processing callback for node 69f8cda70573a8210e12fac5 INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:47:57,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:47:57,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 16:48:00,512 - lava_callback - INFO - Received callback for node 69f8cda80573a8210e12fac8 INFO: 172.20.0.1:49254 - "POST /node/69f8cda80573a8210e12fac8 HTTP/1.0" 202 Accepted 2026-05-04 16:48:00,571 - lava_callback - INFO - Starting async job submit for node 69f8cda80573a8210e12fac8 2026-05-04 16:48:00,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:00,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda80573a8210e12fac8 HTTP/1.1" 200 None 2026-05-04 16:48:00,632 - lava_callback - DEBUG - Processing node 69f8cda80573a8210e12fac8: baseline-arm 2026-05-04 16:48:00,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:00,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:00,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda80573a8210e12fac8/log.txt.gz 2026-05-04 16:48:00,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:01,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:01,108 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda80573a8210e12fac8/lava-logs.yaml 2026-05-04 16:48:01,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:01,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:01,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda80573a8210e12fac8/lava_callback.json.gz 2026-05-04 16:48:01,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:01,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda80573a8210e12fac8 HTTP/1.1" 200 None 2026-05-04 16:48:01,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:01,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:48:01,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:01,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cda80573a8210e12fac8 HTTP/1.1" 200 None 2026-05-04 16:48:01,270 - lava_callback - INFO - Completed processing callback for node 69f8cda80573a8210e12fac8 INFO: 172.20.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:48:19,620 - lava_callback - INFO - Received callback for node 69f62acc8234569b79a1ea9d INFO: 172.20.0.1:42736 - "POST /node/69f62acc8234569b79a1ea9d HTTP/1.0" 202 Accepted 2026-05-04 16:48:19,626 - lava_callback - INFO - Starting async job submit for node 69f62acc8234569b79a1ea9d 2026-05-04 16:48:19,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:19,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62acc8234569b79a1ea9d HTTP/1.1" 200 None 2026-05-04 16:48:19,643 - lava_callback - DEBUG - Processing node 69f62acc8234569b79a1ea9d: baseline-arm64-baylibre 2026-05-04 16:48:19,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62acc8234569b79a1ea9d 2026-05-04 16:48:19,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:19,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62acc8234569b79a1ea9d HTTP/1.1" 200 None 2026-05-04 16:48:19,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:19,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:19,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:19,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62acc8234569b79a1ea9d HTTP/1.1" 200 None 2026-05-04 16:48:19,694 - lava_callback - ERROR - Error processing callback for node 69f62acc8234569b79a1ea9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:20,261 - lava_callback - INFO - Received callback for node 69f62acd8234569b79a1eaa0 INFO: 172.20.0.1:47216 - "POST /node/69f62acd8234569b79a1eaa0 HTTP/1.0" 202 Accepted 2026-05-04 16:48:20,267 - lava_callback - INFO - Starting async job submit for node 69f62acd8234569b79a1eaa0 2026-05-04 16:48:20,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62acd8234569b79a1eaa0 HTTP/1.1" 200 None 2026-05-04 16:48:20,282 - lava_callback - DEBUG - Processing node 69f62acd8234569b79a1eaa0: baseline-arm64-baylibre 2026-05-04 16:48:20,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62acd8234569b79a1eaa0 2026-05-04 16:48:20,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62acd8234569b79a1eaa0 HTTP/1.1" 200 None 2026-05-04 16:48:20,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:20,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62acd8234569b79a1eaa0 HTTP/1.1" 200 None 2026-05-04 16:48:20,350 - lava_callback - ERROR - Error processing callback for node 69f62acd8234569b79a1eaa0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47230 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:48:20,923 - lava_callback - INFO - Received callback for node 69f62acf8234569b79a1eaa3 INFO: 172.20.0.1:47234 - "POST /node/69f62acf8234569b79a1eaa3 HTTP/1.0" 202 Accepted 2026-05-04 16:48:20,929 - lava_callback - INFO - Starting async job submit for node 69f62acf8234569b79a1eaa3 2026-05-04 16:48:20,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62acf8234569b79a1eaa3 HTTP/1.1" 200 None 2026-05-04 16:48:20,952 - lava_callback - DEBUG - Processing node 69f62acf8234569b79a1eaa3: baseline-arm64-baylibre 2026-05-04 16:48:20,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62acf8234569b79a1eaa3 2026-05-04 16:48:20,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62acf8234569b79a1eaa3 HTTP/1.1" 200 None 2026-05-04 16:48:20,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:20,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:20,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62acf8234569b79a1eaa3 HTTP/1.1" 200 None 2026-05-04 16:48:20,997 - lava_callback - ERROR - Error processing callback for node 69f62acf8234569b79a1eaa3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:21,619 - lava_callback - INFO - Received callback for node 69f62ad18234569b79a1eaaa INFO: 172.20.0.1:47250 - "POST /node/69f62ad18234569b79a1eaaa HTTP/1.0" 202 Accepted 2026-05-04 16:48:21,625 - lava_callback - INFO - Starting async job submit for node 69f62ad18234569b79a1eaaa 2026-05-04 16:48:21,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:21,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ad18234569b79a1eaaa HTTP/1.1" 200 None 2026-05-04 16:48:21,649 - lava_callback - DEBUG - Processing node 69f62ad18234569b79a1eaaa: baseline-arm64-baylibre 2026-05-04 16:48:21,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ad18234569b79a1eaaa 2026-05-04 16:48:21,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:21,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ad18234569b79a1eaaa HTTP/1.1" 200 None 2026-05-04 16:48:21,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:21,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:21,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:21,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ad18234569b79a1eaaa HTTP/1.1" 200 None 2026-05-04 16:48:21,697 - lava_callback - ERROR - Error processing callback for node 69f62ad18234569b79a1eaaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:23,600 - lava_callback - INFO - Received callback for node 69f8cdab0573a8210e12fad1 INFO: 172.20.0.1:47252 - "POST /node/69f8cdab0573a8210e12fad1 HTTP/1.0" 202 Accepted 2026-05-04 16:48:23,650 - lava_callback - INFO - Starting async job submit for node 69f8cdab0573a8210e12fad1 2026-05-04 16:48:23,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:23,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdab0573a8210e12fad1 HTTP/1.1" 200 None 2026-05-04 16:48:23,684 - lava_callback - DEBUG - Processing node 69f8cdab0573a8210e12fad1: baseline-arm 2026-05-04 16:48:23,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:23,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:23,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cdab0573a8210e12fad1/log.txt.gz 2026-05-04 16:48:23,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:24,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:24,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cdab0573a8210e12fad1/lava-logs.yaml 2026-05-04 16:48:24,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:24,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:24,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cdab0573a8210e12fad1/lava_callback.json.gz 2026-05-04 16:48:24,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:24,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdab0573a8210e12fad1 HTTP/1.1" 200 None 2026-05-04 16:48:24,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:24,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:48:24,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:24,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdab0573a8210e12fad1 HTTP/1.1" 200 None 2026-05-04 16:48:24,287 - lava_callback - INFO - Completed processing callback for node 69f8cdab0573a8210e12fad1 INFO: 172.20.0.1:47256 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:48:27,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:27,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44134 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:48:39,616 - lava_callback - INFO - Received callback for node 69f62ad28234569b79a1eaad INFO: 172.20.0.1:44146 - "POST /node/69f62ad28234569b79a1eaad HTTP/1.0" 202 Accepted 2026-05-04 16:48:39,622 - lava_callback - INFO - Starting async job submit for node 69f62ad28234569b79a1eaad 2026-05-04 16:48:39,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ad28234569b79a1eaad HTTP/1.1" 200 None 2026-05-04 16:48:39,637 - lava_callback - DEBUG - Processing node 69f62ad28234569b79a1eaad: baseline-arm64-baylibre 2026-05-04 16:48:39,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ad28234569b79a1eaad 2026-05-04 16:48:39,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:39,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ad28234569b79a1eaad HTTP/1.1" 200 None 2026-05-04 16:48:39,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:39,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:39,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:39,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ad28234569b79a1eaad HTTP/1.1" 200 None 2026-05-04 16:48:39,701 - lava_callback - ERROR - Error processing callback for node 69f62ad28234569b79a1eaad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:40,263 - lava_callback - INFO - Received callback for node 69f62ad48234569b79a1eab0 INFO: 172.20.0.1:34646 - "POST /node/69f62ad48234569b79a1eab0 HTTP/1.0" 202 Accepted 2026-05-04 16:48:40,268 - lava_callback - INFO - Starting async job submit for node 69f62ad48234569b79a1eab0 2026-05-04 16:48:40,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:40,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ad48234569b79a1eab0 HTTP/1.1" 200 None 2026-05-04 16:48:40,294 - lava_callback - DEBUG - Processing node 69f62ad48234569b79a1eab0: baseline-arm64-baylibre 2026-05-04 16:48:40,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ad48234569b79a1eab0 2026-05-04 16:48:40,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:40,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ad48234569b79a1eab0 HTTP/1.1" 200 None 2026-05-04 16:48:40,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:40,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:40,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:40,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ad48234569b79a1eab0 HTTP/1.1" 200 None 2026-05-04 16:48:40,347 - lava_callback - ERROR - Error processing callback for node 69f62ad48234569b79a1eab0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:44,560 - lava_callback - INFO - Received callback for node 69f62ae38234569b79a1eafe INFO: 172.20.0.1:34658 - "POST /node/69f62ae38234569b79a1eafe HTTP/1.0" 202 Accepted 2026-05-04 16:48:44,565 - lava_callback - INFO - Starting async job submit for node 69f62ae38234569b79a1eafe 2026-05-04 16:48:44,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:44,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae38234569b79a1eafe HTTP/1.1" 200 None 2026-05-04 16:48:44,593 - lava_callback - DEBUG - Processing node 69f62ae38234569b79a1eafe: baseline-arm64-clabbe 2026-05-04 16:48:44,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ae38234569b79a1eafe 2026-05-04 16:48:44,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:44,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae38234569b79a1eafe HTTP/1.1" 200 None 2026-05-04 16:48:44,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:44,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:44,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:44,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ae38234569b79a1eafe HTTP/1.1" 200 None 2026-05-04 16:48:44,692 - lava_callback - ERROR - Error processing callback for node 69f62ae38234569b79a1eafe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:45,286 - lava_callback - INFO - Received callback for node 69f62ae58234569b79a1eb01 INFO: 172.20.0.1:34660 - "POST /node/69f62ae58234569b79a1eb01 HTTP/1.0" 202 Accepted 2026-05-04 16:48:45,292 - lava_callback - INFO - Starting async job submit for node 69f62ae58234569b79a1eb01 2026-05-04 16:48:45,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:45,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae58234569b79a1eb01 HTTP/1.1" 200 None 2026-05-04 16:48:45,319 - lava_callback - DEBUG - Processing node 69f62ae58234569b79a1eb01: baseline-arm64-clabbe 2026-05-04 16:48:45,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ae58234569b79a1eb01 2026-05-04 16:48:45,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:45,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae58234569b79a1eb01 HTTP/1.1" 200 None 2026-05-04 16:48:45,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:45,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:45,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:45,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ae58234569b79a1eb01 HTTP/1.1" 200 None 2026-05-04 16:48:45,365 - lava_callback - ERROR - Error processing callback for node 69f62ae58234569b79a1eb01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:45,957 - lava_callback - INFO - Received callback for node 69f62ae68234569b79a1eb04 INFO: 172.20.0.1:34670 - "POST /node/69f62ae68234569b79a1eb04 HTTP/1.0" 202 Accepted 2026-05-04 16:48:45,962 - lava_callback - INFO - Starting async job submit for node 69f62ae68234569b79a1eb04 2026-05-04 16:48:45,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:45,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae68234569b79a1eb04 HTTP/1.1" 200 None 2026-05-04 16:48:45,977 - lava_callback - DEBUG - Processing node 69f62ae68234569b79a1eb04: baseline-arm64-clabbe 2026-05-04 16:48:45,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ae68234569b79a1eb04 2026-05-04 16:48:45,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:45,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae68234569b79a1eb04 HTTP/1.1" 200 None 2026-05-04 16:48:45,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:46,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:46,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:46,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ae68234569b79a1eb04 HTTP/1.1" 200 None 2026-05-04 16:48:46,024 - lava_callback - ERROR - Error processing callback for node 69f62ae68234569b79a1eb04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34672 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:48:46,693 - lava_callback - INFO - Received callback for node 69f62ae78234569b79a1eb07 INFO: 172.20.0.1:34682 - "POST /node/69f62ae78234569b79a1eb07 HTTP/1.0" 202 Accepted 2026-05-04 16:48:46,699 - lava_callback - INFO - Starting async job submit for node 69f62ae78234569b79a1eb07 2026-05-04 16:48:46,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:46,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae78234569b79a1eb07 HTTP/1.1" 200 None 2026-05-04 16:48:46,715 - lava_callback - DEBUG - Processing node 69f62ae78234569b79a1eb07: baseline-arm64-clabbe 2026-05-04 16:48:46,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ae78234569b79a1eb07 2026-05-04 16:48:46,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:46,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae78234569b79a1eb07 HTTP/1.1" 200 None 2026-05-04 16:48:46,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:46,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:46,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:46,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ae78234569b79a1eb07 HTTP/1.1" 200 None 2026-05-04 16:48:46,765 - lava_callback - ERROR - Error processing callback for node 69f62ae78234569b79a1eb07: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:47,369 - lava_callback - INFO - Received callback for node 69f62ae98234569b79a1eb12 INFO: 172.20.0.1:34686 - "POST /node/69f62ae98234569b79a1eb12 HTTP/1.0" 202 Accepted 2026-05-04 16:48:47,375 - lava_callback - INFO - Starting async job submit for node 69f62ae98234569b79a1eb12 2026-05-04 16:48:47,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:47,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae98234569b79a1eb12 HTTP/1.1" 200 None 2026-05-04 16:48:47,391 - lava_callback - DEBUG - Processing node 69f62ae98234569b79a1eb12: baseline-arm64-clabbe 2026-05-04 16:48:47,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ae98234569b79a1eb12 2026-05-04 16:48:47,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:47,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae98234569b79a1eb12 HTTP/1.1" 200 None 2026-05-04 16:48:47,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:47,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:47,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:47,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ae98234569b79a1eb12 HTTP/1.1" 200 None 2026-05-04 16:48:47,444 - lava_callback - ERROR - Error processing callback for node 69f62ae98234569b79a1eb12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:48,110 - lava_callback - INFO - Received callback for node 69f62ae88234569b79a1eb0d INFO: 172.20.0.1:34702 - "POST /node/69f62ae88234569b79a1eb0d HTTP/1.0" 202 Accepted 2026-05-04 16:48:48,116 - lava_callback - INFO - Starting async job submit for node 69f62ae88234569b79a1eb0d 2026-05-04 16:48:48,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:48,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae88234569b79a1eb0d HTTP/1.1" 200 None 2026-05-04 16:48:48,132 - lava_callback - DEBUG - Processing node 69f62ae88234569b79a1eb0d: baseline-arm64-clabbe 2026-05-04 16:48:48,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ae88234569b79a1eb0d 2026-05-04 16:48:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:48,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ae88234569b79a1eb0d HTTP/1.1" 200 None 2026-05-04 16:48:48,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:48,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 16:48:48,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:48,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ae88234569b79a1eb0d HTTP/1.1" 200 None 2026-05-04 16:48:48,195 - lava_callback - ERROR - Error processing callback for node 69f62ae88234569b79a1eb0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 16:48:49,373 - lava_callback - INFO - Received callback for node 69f8cdaa0573a8210e12face INFO: 172.20.0.1:34714 - "POST /node/69f8cdaa0573a8210e12face HTTP/1.0" 202 Accepted 2026-05-04 16:48:49,379 - lava_callback - INFO - Starting async job submit for node 69f8cdaa0573a8210e12face 2026-05-04 16:48:49,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:49,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdaa0573a8210e12face HTTP/1.1" 200 None 2026-05-04 16:48:49,444 - lava_callback - DEBUG - Processing node 69f8cdaa0573a8210e12face: baseline-arm 2026-05-04 16:48:49,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:49,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:49,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cdaa0573a8210e12face/log.txt.gz 2026-05-04 16:48:49,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:50,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:50,093 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cdaa0573a8210e12face/lava-logs.yaml 2026-05-04 16:48:50,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:50,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:50,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cdaa0573a8210e12face/lava_callback.json.gz 2026-05-04 16:48:50,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:50,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdaa0573a8210e12face HTTP/1.1" 200 None 2026-05-04 16:48:50,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:50,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:48:50,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:50,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdaa0573a8210e12face HTTP/1.1" 200 None 2026-05-04 16:48:50,263 - lava_callback - INFO - Completed processing callback for node 69f8cdaa0573a8210e12face 2026-05-04 16:48:51,862 - lava_callback - INFO - Received callback for node 69f8cda70573a8210e12fac2 INFO: 172.20.0.1:33158 - "POST /node/69f8cda70573a8210e12fac2 HTTP/1.0" 202 Accepted 2026-05-04 16:48:51,868 - lava_callback - INFO - Starting async job submit for node 69f8cda70573a8210e12fac2 2026-05-04 16:48:51,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:51,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda70573a8210e12fac2 HTTP/1.1" 200 None 2026-05-04 16:48:51,904 - lava_callback - DEBUG - Processing node 69f8cda70573a8210e12fac2: baseline-arm 2026-05-04 16:48:52,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:52,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:52,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda70573a8210e12fac2/log.txt.gz 2026-05-04 16:48:52,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:52,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:52,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda70573a8210e12fac2/lava-logs.yaml 2026-05-04 16:48:52,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:48:52,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:48:52,503 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda70573a8210e12fac2/lava_callback.json.gz 2026-05-04 16:48:52,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:52,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda70573a8210e12fac2 HTTP/1.1" 200 None 2026-05-04 16:48:52,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:52,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:48:52,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:52,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cda70573a8210e12fac2 HTTP/1.1" 200 None 2026-05-04 16:48:52,581 - lava_callback - INFO - Completed processing callback for node 69f8cda70573a8210e12fac2 INFO: 172.20.0.1:33172 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:48:57,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:48:57,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36612 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:49:31,721 - lava_callback - INFO - Received callback for node 69f8cdcb0573a8210e12fb6d INFO: 172.20.0.1:51914 - "POST /node/69f8cdcb0573a8210e12fb6d HTTP/1.0" 202 Accepted 2026-05-04 16:49:31,769 - lava_callback - INFO - Starting async job submit for node 69f8cdcb0573a8210e12fb6d 2026-05-04 16:49:31,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:31,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdcb0573a8210e12fb6d HTTP/1.1" 200 None 2026-05-04 16:49:31,804 - lava_callback - DEBUG - Processing node 69f8cdcb0573a8210e12fb6d: baseline-arm-pengutronix 2026-05-04 16:49:31,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:32,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:32,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdcb0573a8210e12fb6d/log.txt.gz 2026-05-04 16:49:32,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:32,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:32,238 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdcb0573a8210e12fb6d/lava-logs.yaml 2026-05-04 16:49:32,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:32,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:32,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdcb0573a8210e12fb6d/lava_callback.json.gz 2026-05-04 16:49:32,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:32,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdcb0573a8210e12fb6d HTTP/1.1" 200 None 2026-05-04 16:49:32,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:32,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:49:32,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:32,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdcb0573a8210e12fb6d HTTP/1.1" 200 None 2026-05-04 16:49:32,584 - lava_callback - INFO - Completed processing callback for node 69f8cdcb0573a8210e12fb6d INFO: 172.20.0.1:51926 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:49:36,769 - lava_callback - INFO - Received callback for node 69f8cdca0573a8210e12fb6a INFO: 172.20.0.1:51938 - "POST /node/69f8cdca0573a8210e12fb6a HTTP/1.0" 202 Accepted 2026-05-04 16:49:36,775 - lava_callback - INFO - Starting async job submit for node 69f8cdca0573a8210e12fb6a 2026-05-04 16:49:36,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:36,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdca0573a8210e12fb6a HTTP/1.1" 200 None 2026-05-04 16:49:36,825 - lava_callback - DEBUG - Processing node 69f8cdca0573a8210e12fb6a: baseline-arm-pengutronix 2026-05-04 16:49:37,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:37,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:37,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdca0573a8210e12fb6a/log.txt.gz 2026-05-04 16:49:37,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:37,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:37,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdca0573a8210e12fb6a/lava-logs.yaml 2026-05-04 16:49:37,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:37,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:37,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdca0573a8210e12fb6a/lava_callback.json.gz 2026-05-04 16:49:37,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:37,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdca0573a8210e12fb6a HTTP/1.1" 200 None 2026-05-04 16:49:37,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:37,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:49:37,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:37,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdca0573a8210e12fb6a HTTP/1.1" 200 None 2026-05-04 16:49:37,863 - lava_callback - INFO - Completed processing callback for node 69f8cdca0573a8210e12fb6a 2026-05-04 16:49:37,926 - lava_callback - INFO - Received callback for node 69f8cdc90573a8210e12fb67 INFO: 172.20.0.1:51940 - "POST /node/69f8cdc90573a8210e12fb67 HTTP/1.0" 202 Accepted 2026-05-04 16:49:37,934 - lava_callback - INFO - Starting async job submit for node 69f8cdc90573a8210e12fb67 2026-05-04 16:49:37,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:37,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc90573a8210e12fb67 HTTP/1.1" 200 None 2026-05-04 16:49:37,976 - lava_callback - DEBUG - Processing node 69f8cdc90573a8210e12fb67: baseline-arm-pengutronix 2026-05-04 16:49:38,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:38,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:38,247 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdc90573a8210e12fb67/log.txt.gz 2026-05-04 16:49:38,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:38,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:38,466 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdc90573a8210e12fb67/lava-logs.yaml 2026-05-04 16:49:38,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:38,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:38,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69f8cdc90573a8210e12fb67/lava_callback.json.gz 2026-05-04 16:49:38,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:38,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc90573a8210e12fb67 HTTP/1.1" 200 None 2026-05-04 16:49:38,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:38,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:49:38,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:38,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc90573a8210e12fb67 HTTP/1.1" 200 None 2026-05-04 16:49:38,646 - lava_callback - INFO - Completed processing callback for node 69f8cdc90573a8210e12fb67 2026-05-04 16:49:43,178 - lava_callback - INFO - Received callback for node 69f8cdc50573a8210e12fb56 INFO: 172.20.0.1:59326 - "POST /node/69f8cdc50573a8210e12fb56 HTTP/1.0" 202 Accepted 2026-05-04 16:49:43,184 - lava_callback - INFO - Starting async job submit for node 69f8cdc50573a8210e12fb56 2026-05-04 16:49:43,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:43,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc50573a8210e12fb56 HTTP/1.1" 200 None 2026-05-04 16:49:43,220 - lava_callback - DEBUG - Processing node 69f8cdc50573a8210e12fb56: baseline-arm-kontron 2026-05-04 16:49:43,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:43,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:43,475 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f8cdc50573a8210e12fb56/log.txt.gz 2026-05-04 16:49:43,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:43,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:43,710 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f8cdc50573a8210e12fb56/lava-logs.yaml 2026-05-04 16:49:43,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:43,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:43,810 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f8cdc50573a8210e12fb56/lava_callback.json.gz 2026-05-04 16:49:43,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:43,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc50573a8210e12fb56 HTTP/1.1" 200 None 2026-05-04 16:49:43,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:43,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:49:43,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:43,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc50573a8210e12fb56 HTTP/1.1" 200 None 2026-05-04 16:49:43,888 - lava_callback - INFO - Completed processing callback for node 69f8cdc50573a8210e12fb56 2026-05-04 16:49:44,416 - lava_callback - INFO - Received callback for node 69f8cdc60573a8210e12fb5c INFO: 172.20.0.1:59328 - "POST /node/69f8cdc60573a8210e12fb5c HTTP/1.0" 202 Accepted 2026-05-04 16:49:44,422 - lava_callback - INFO - Starting async job submit for node 69f8cdc60573a8210e12fb5c 2026-05-04 16:49:44,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:44,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc60573a8210e12fb5c HTTP/1.1" 200 None 2026-05-04 16:49:44,458 - lava_callback - DEBUG - Processing node 69f8cdc60573a8210e12fb5c: baseline-arm-kontron 2026-05-04 16:49:44,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:44,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:44,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f8cdc60573a8210e12fb5c/log.txt.gz 2026-05-04 16:49:44,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:44,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:44,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f8cdc60573a8210e12fb5c/lava-logs.yaml 2026-05-04 16:49:44,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:45,075 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:45,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69f8cdc60573a8210e12fb5c/lava_callback.json.gz 2026-05-04 16:49:45,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:45,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc60573a8210e12fb5c HTTP/1.1" 200 None 2026-05-04 16:49:45,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:45,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:49:45,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:45,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc60573a8210e12fb5c HTTP/1.1" 200 None 2026-05-04 16:49:45,151 - lava_callback - INFO - Completed processing callback for node 69f8cdc60573a8210e12fb5c INFO: 172.20.0.1:59336 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:49:48,707 - lava_callback - INFO - Received callback for node 69f8cdbd0573a8210e12fb39 INFO: 172.20.0.1:59346 - "POST /node/69f8cdbd0573a8210e12fb39 HTTP/1.0" 202 Accepted 2026-05-04 16:49:48,714 - lava_callback - INFO - Starting async job submit for node 69f8cdbd0573a8210e12fb39 2026-05-04 16:49:48,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:48,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbd0573a8210e12fb39 HTTP/1.1" 200 None 2026-05-04 16:49:48,750 - lava_callback - DEBUG - Processing node 69f8cdbd0573a8210e12fb39: baseline-arm-clabbe 2026-05-04 16:49:48,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:49,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:49,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdbd0573a8210e12fb39/log.txt.gz 2026-05-04 16:49:49,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:49,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:49,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdbd0573a8210e12fb39/lava-logs.yaml 2026-05-04 16:49:49,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:49:49,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:49:49,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdbd0573a8210e12fb39/lava_callback.json.gz 2026-05-04 16:49:49,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:49,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbd0573a8210e12fb39 HTTP/1.1" 200 None 2026-05-04 16:49:49,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:49,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:49:49,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:49,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdbd0573a8210e12fb39 HTTP/1.1" 200 None 2026-05-04 16:49:49,474 - lava_callback - INFO - Completed processing callback for node 69f8cdbd0573a8210e12fb39 INFO: 172.20.0.1:35322 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:49:57,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:49:57,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47918 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:50:26,721 - lava_callback - INFO - Received callback for node 69f8c9980573a8210e12cf85 INFO: 172.20.0.1:47930 - "POST /node/69f8c9980573a8210e12cf85 HTTP/1.0" 202 Accepted 2026-05-04 16:50:26,728 - lava_callback - INFO - Starting async job submit for node 69f8c9980573a8210e12cf85 2026-05-04 16:50:26,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:26,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9980573a8210e12cf85 HTTP/1.1" 200 None 2026-05-04 16:50:26,802 - lava_callback - DEBUG - Processing node 69f8c9980573a8210e12cf85: ltp-smoke 2026-05-04 16:50:27,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:27,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:27,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8c9980573a8210e12cf85/log.txt.gz 2026-05-04 16:50:27,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:27,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:27,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8c9980573a8210e12cf85/lava-logs.yaml 2026-05-04 16:50:27,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:27,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:27,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8c9980573a8210e12cf85/lava_callback.json.gz 2026-05-04 16:50:28,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:28,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c9980573a8210e12cf85 HTTP/1.1" 200 None 2026-05-04 16:50:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:28,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c66b0573a8210e12ccc7 HTTP/1.1" 200 None 2026-05-04 16:50:28,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:28,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8c9980573a8210e12cf85 HTTP/1.1" 200 None 2026-05-04 16:50:28,271 - lava_callback - INFO - Completed processing callback for node 69f8c9980573a8210e12cf85 2026-05-04 16:50:33,934 - lava_callback - INFO - Received callback for node 69f8ce410573a8210e12fc9c INFO: 172.20.0.1:53170 - "POST /node/69f8ce410573a8210e12fc9c HTTP/1.0" 202 Accepted 2026-05-04 16:50:33,940 - lava_callback - INFO - Starting async job submit for node 69f8ce410573a8210e12fc9c 2026-05-04 16:50:33,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:33,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ce410573a8210e12fc9c HTTP/1.1" 200 None 2026-05-04 16:50:33,960 - lava_callback - DEBUG - Processing node 69f8ce410573a8210e12fc9c: baseline-arm 2026-05-04 16:50:33,965 - lava_callback - WARNING - Failed to upload log 2026-05-04 16:50:33,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:34,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:34,056 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8ce410573a8210e12fc9c/lava-logs.yaml 2026-05-04 16:50:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:34,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:34,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8ce410573a8210e12fc9c/lava_callback.json.gz 2026-05-04 16:50:34,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:34,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8ce410573a8210e12fc9c HTTP/1.1" 200 None 2026-05-04 16:50:34,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:34,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:50:34,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:34,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8ce410573a8210e12fc9c HTTP/1.1" 200 None 2026-05-04 16:50:34,195 - lava_callback - INFO - Completed processing callback for node 69f8ce410573a8210e12fc9c 2026-05-04 16:50:34,734 - lava_callback - INFO - Received callback for node 69f8cdbe0573a8210e12fb3d INFO: 172.20.0.1:53174 - "POST /node/69f8cdbe0573a8210e12fb3d HTTP/1.0" 202 Accepted 2026-05-04 16:50:34,740 - lava_callback - INFO - Starting async job submit for node 69f8cdbe0573a8210e12fb3d 2026-05-04 16:50:34,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:34,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbe0573a8210e12fb3d HTTP/1.1" 200 None 2026-05-04 16:50:34,775 - lava_callback - DEBUG - Processing node 69f8cdbe0573a8210e12fb3d: baseline-arm-clabbe 2026-05-04 16:50:34,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:35,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:35,089 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdbe0573a8210e12fb3d/log.txt.gz 2026-05-04 16:50:35,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:35,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:35,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdbe0573a8210e12fb3d/lava-logs.yaml 2026-05-04 16:50:35,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:35,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:35,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdbe0573a8210e12fb3d/lava_callback.json.gz 2026-05-04 16:50:35,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:35,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdbe0573a8210e12fb3d HTTP/1.1" 200 None 2026-05-04 16:50:35,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:35,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:50:35,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:35,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdbe0573a8210e12fb3d HTTP/1.1" 200 None 2026-05-04 16:50:35,628 - lava_callback - INFO - Completed processing callback for node 69f8cdbe0573a8210e12fb3d INFO: 172.20.0.1:53184 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:50:37,648 - lava_callback - INFO - Received callback for node 69f8cde30573a8210e12fbca INFO: 172.20.0.1:53194 - "POST /node/69f8cde30573a8210e12fbca HTTP/1.0" 202 Accepted 2026-05-04 16:50:37,655 - lava_callback - INFO - Starting async job submit for node 69f8cde30573a8210e12fbca 2026-05-04 16:50:37,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:37,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cde30573a8210e12fbca HTTP/1.1" 200 None 2026-05-04 16:50:37,693 - lava_callback - DEBUG - Processing node 69f8cde30573a8210e12fbca: ltp-dio 2026-05-04 16:50:38,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:38,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:38,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69f8cde30573a8210e12fbca/log.txt.gz 2026-05-04 16:50:38,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:38,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:38,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69f8cde30573a8210e12fbca/lava-logs.yaml 2026-05-04 16:50:38,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:50:38,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:50:38,890 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69f8cde30573a8210e12fbca/lava_callback.json.gz 2026-05-04 16:50:38,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:38,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cde30573a8210e12fbca HTTP/1.1" 200 None 2026-05-04 16:50:38,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:38,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:50:38,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:38,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cde30573a8210e12fbca HTTP/1.1" 200 None 2026-05-04 16:50:38,971 - lava_callback - INFO - Completed processing callback for node 69f8cde30573a8210e12fbca INFO: 172.20.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41948 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:50:57,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:50:57,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52364 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:51:39,750 - lava_callback - INFO - Received callback for node 69f62b8a8234569b79a1ec8e INFO: 172.20.0.1:49438 - "POST /node/69f62b8a8234569b79a1ec8e HTTP/1.0" 202 Accepted 2026-05-04 16:51:39,756 - lava_callback - INFO - Starting async job submit for node 69f62b8a8234569b79a1ec8e 2026-05-04 16:51:39,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:39,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62b8a8234569b79a1ec8e HTTP/1.1" 200 None 2026-05-04 16:51:39,772 - lava_callback - DEBUG - Processing node 69f62b8a8234569b79a1ec8e: baseline-arm-baylibre 2026-05-04 16:51:39,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62b8a8234569b79a1ec8e 2026-05-04 16:51:39,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:39,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62b8a8234569b79a1ec8e HTTP/1.1" 200 None 2026-05-04 16:51:39,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:39,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 16:51:39,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:39,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62b8a8234569b79a1ec8e HTTP/1.1" 200 None 2026-05-04 16:51:39,826 - lava_callback - ERROR - Error processing callback for node 69f62b8a8234569b79a1ec8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49444 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:51:48,867 - lava_callback - INFO - Received callback for node 69f8cdc20573a8210e12fb50 INFO: 172.20.0.1:49460 - "POST /node/69f8cdc20573a8210e12fb50 HTTP/1.0" 202 Accepted 2026-05-04 16:51:48,873 - lava_callback - INFO - Starting async job submit for node 69f8cdc20573a8210e12fb50 2026-05-04 16:51:48,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:48,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc20573a8210e12fb50 HTTP/1.1" 200 None 2026-05-04 16:51:48,911 - lava_callback - DEBUG - Processing node 69f8cdc20573a8210e12fb50: baseline-arm-clabbe 2026-05-04 16:51:49,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:51:49,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:51:49,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdc20573a8210e12fb50/log.txt.gz 2026-05-04 16:51:49,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:51:49,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:51:49,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdc20573a8210e12fb50/lava-logs.yaml 2026-05-04 16:51:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:51:49,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:51:49,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69f8cdc20573a8210e12fb50/lava_callback.json.gz 2026-05-04 16:51:49,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:49,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdc20573a8210e12fb50 HTTP/1.1" 200 None 2026-05-04 16:51:49,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:49,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 16:51:49,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:49,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdc20573a8210e12fb50 HTTP/1.1" 200 None 2026-05-04 16:51:49,909 - lava_callback - INFO - Completed processing callback for node 69f8cdc20573a8210e12fb50 INFO: 172.20.0.1:59252 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:51:57,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:51:57,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47614 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:52:19,745 - lava_callback - INFO - Received callback for node 69f62bb08234569b79a1ecaf INFO: 172.20.0.1:46398 - "POST /node/69f62bb08234569b79a1ecaf HTTP/1.0" 202 Accepted 2026-05-04 16:52:19,752 - lava_callback - INFO - Starting async job submit for node 69f62bb08234569b79a1ecaf 2026-05-04 16:52:19,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:19,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62bb08234569b79a1ecaf HTTP/1.1" 200 None 2026-05-04 16:52:19,780 - lava_callback - DEBUG - Processing node 69f62bb08234569b79a1ecaf: baseline-arm-baylibre 2026-05-04 16:52:19,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62bb08234569b79a1ecaf 2026-05-04 16:52:19,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:19,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62bb08234569b79a1ecaf HTTP/1.1" 200 None 2026-05-04 16:52:19,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:19,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 16:52:19,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:19,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62bb08234569b79a1ecaf HTTP/1.1" 200 None 2026-05-04 16:52:19,930 - lava_callback - ERROR - Error processing callback for node 69f62bb08234569b79a1ecaf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39998 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:52:39,789 - lava_callback - INFO - Received callback for node 69f62bd58234569b79a1ecde INFO: 172.20.0.1:43632 - "POST /node/69f62bd58234569b79a1ecde HTTP/1.0" 202 Accepted 2026-05-04 16:52:39,799 - lava_callback - INFO - Starting async job submit for node 69f62bd58234569b79a1ecde 2026-05-04 16:52:39,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:39,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62bd58234569b79a1ecde HTTP/1.1" 200 None 2026-05-04 16:52:39,837 - lava_callback - DEBUG - Processing node 69f62bd58234569b79a1ecde: baseline-arm-baylibre 2026-05-04 16:52:39,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62bd58234569b79a1ecde 2026-05-04 16:52:39,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:39,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62bd58234569b79a1ecde HTTP/1.1" 200 None 2026-05-04 16:52:39,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:39,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 16:52:39,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:39,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62bd58234569b79a1ecde HTTP/1.1" 200 None 2026-05-04 16:52:39,940 - lava_callback - ERROR - Error processing callback for node 69f62bd58234569b79a1ecde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34236 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:52:59,736 - lava_callback - INFO - Received callback for node 69f8cec40573a8210e12fd5b INFO: 172.20.0.1:37906 - "POST /node/69f8cec40573a8210e12fd5b HTTP/1.0" 202 Accepted 2026-05-04 16:52:59,742 - lava_callback - INFO - Starting async job submit for node 69f8cec40573a8210e12fd5b 2026-05-04 16:52:59,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:52:59,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec40573a8210e12fd5b HTTP/1.1" 200 None 2026-05-04 16:52:59,784 - lava_callback - DEBUG - Processing node 69f8cec40573a8210e12fd5b: baseline-x86 2026-05-04 16:52:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:00,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:00,066 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec40573a8210e12fd5b/log.txt.gz 2026-05-04 16:53:00,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:00,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:00,307 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec40573a8210e12fd5b/lava-logs.yaml 2026-05-04 16:53:00,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:00,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:00,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec40573a8210e12fd5b/lava_callback.json.gz 2026-05-04 16:53:00,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:00,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec40573a8210e12fd5b HTTP/1.1" 200 None 2026-05-04 16:53:00,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:00,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6920573a8210e12ccf3 HTTP/1.1" 200 None 2026-05-04 16:53:00,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:00,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cec40573a8210e12fd5b HTTP/1.1" 200 None 2026-05-04 16:53:00,723 - lava_callback - INFO - Completed processing callback for node 69f8cec40573a8210e12fd5b INFO: 172.20.0.1:37920 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:53:06,934 - lava_callback - INFO - Received callback for node 69f8cec20573a8210e12fd50 INFO: 172.20.0.1:37924 - "POST /node/69f8cec20573a8210e12fd50 HTTP/1.0" 202 Accepted 2026-05-04 16:53:06,942 - lava_callback - INFO - Starting async job submit for node 69f8cec20573a8210e12fd50 2026-05-04 16:53:06,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:06,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec20573a8210e12fd50 HTTP/1.1" 200 None 2026-05-04 16:53:06,984 - lava_callback - DEBUG - Processing node 69f8cec20573a8210e12fd50: baseline-x86 2026-05-04 16:53:07,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:07,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:07,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec20573a8210e12fd50/log.txt.gz 2026-05-04 16:53:07,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:07,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:07,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec20573a8210e12fd50/lava-logs.yaml 2026-05-04 16:53:07,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:07,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:07,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec20573a8210e12fd50/lava_callback.json.gz 2026-05-04 16:53:07,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:07,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec20573a8210e12fd50 HTTP/1.1" 200 None 2026-05-04 16:53:07,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:07,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6920573a8210e12ccf3 HTTP/1.1" 200 None 2026-05-04 16:53:07,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:07,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cec20573a8210e12fd50 HTTP/1.1" 200 None 2026-05-04 16:53:07,721 - lava_callback - INFO - Completed processing callback for node 69f8cec20573a8210e12fd50 INFO: 172.20.0.1:53396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35994 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:53:27,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:27,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55348 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:53:47,316 - lava_callback - INFO - Received callback for node 69f8cec20573a8210e12fd53 INFO: 172.20.0.1:55358 - "POST /node/69f8cec20573a8210e12fd53 HTTP/1.0" 202 Accepted 2026-05-04 16:53:47,325 - lava_callback - INFO - Starting async job submit for node 69f8cec20573a8210e12fd53 2026-05-04 16:53:47,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:47,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec20573a8210e12fd53 HTTP/1.1" 200 None 2026-05-04 16:53:47,364 - lava_callback - DEBUG - Processing node 69f8cec20573a8210e12fd53: baseline-x86 2026-05-04 16:53:47,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:47,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:47,742 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec20573a8210e12fd53/log.txt.gz 2026-05-04 16:53:47,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:48,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:48,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec20573a8210e12fd53/lava-logs.yaml 2026-05-04 16:53:48,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 16:53:48,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 16:53:48,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec20573a8210e12fd53/lava_callback.json.gz 2026-05-04 16:53:48,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:48,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec20573a8210e12fd53 HTTP/1.1" 200 None 2026-05-04 16:53:48,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:48,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6920573a8210e12ccf3 HTTP/1.1" 200 None 2026-05-04 16:53:48,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:48,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cec20573a8210e12fd53 HTTP/1.1" 200 None 2026-05-04 16:53:48,261 - lava_callback - INFO - Completed processing callback for node 69f8cec20573a8210e12fd53 INFO: 172.20.0.1:39902 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:53:57,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:53:57,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35630 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:55:00,039 - lava_callback - INFO - Received callback for node 69f62c5e8234569b79a1ed10 INFO: 172.20.0.1:53908 - "POST /node/69f62c5e8234569b79a1ed10 HTTP/1.0" 202 Accepted 2026-05-04 16:55:00,045 - lava_callback - INFO - Starting async job submit for node 69f62c5e8234569b79a1ed10 2026-05-04 16:55:00,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:55:00,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62c5e8234569b79a1ed10 HTTP/1.1" 200 None 2026-05-04 16:55:00,061 - lava_callback - DEBUG - Processing node 69f62c5e8234569b79a1ed10: baseline-arm-baylibre 2026-05-04 16:55:00,062 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62c5e8234569b79a1ed10 2026-05-04 16:55:00,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:55:00,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62c5e8234569b79a1ed10 HTTP/1.1" 200 None 2026-05-04 16:55:00,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:55:00,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 16:55:00,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:55:00,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62c5e8234569b79a1ed10 HTTP/1.1" 200 None 2026-05-04 16:55:00,113 - lava_callback - ERROR - Error processing callback for node 69f62c5e8234569b79a1ed10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:56:20,081 - lava_callback - INFO - Received callback for node 69f62ca68234569b79a1ed43 INFO: 172.20.0.1:45086 - "POST /node/69f62ca68234569b79a1ed43 HTTP/1.0" 202 Accepted 2026-05-04 16:56:20,086 - lava_callback - INFO - Starting async job submit for node 69f62ca68234569b79a1ed43 2026-05-04 16:56:20,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:56:20,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ca68234569b79a1ed43 HTTP/1.1" 200 None 2026-05-04 16:56:20,107 - lava_callback - DEBUG - Processing node 69f62ca68234569b79a1ed43: baseline-arm-baylibre 2026-05-04 16:56:20,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62ca68234569b79a1ed43 2026-05-04 16:56:20,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:56:20,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62ca68234569b79a1ed43 HTTP/1.1" 200 None 2026-05-04 16:56:20,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:56:20,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 16:56:20,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:56:20,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62ca68234569b79a1ed43 HTTP/1.1" 200 None 2026-05-04 16:56:20,164 - lava_callback - ERROR - Error processing callback for node 69f62ca68234569b79a1ed43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54392 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:57:20,034 - lava_callback - INFO - Received callback for node 69f62cec8234569b79a1ed61 INFO: 172.20.0.1:39910 - "POST /node/69f62cec8234569b79a1ed61 HTTP/1.0" 202 Accepted 2026-05-04 16:57:20,040 - lava_callback - INFO - Starting async job submit for node 69f62cec8234569b79a1ed61 2026-05-04 16:57:20,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:57:20,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62cec8234569b79a1ed61 HTTP/1.1" 200 None 2026-05-04 16:57:20,062 - lava_callback - DEBUG - Processing node 69f62cec8234569b79a1ed61: baseline-arm-baylibre 2026-05-04 16:57:20,063 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62cec8234569b79a1ed61 2026-05-04 16:57:20,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:57:20,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62cec8234569b79a1ed61 HTTP/1.1" 200 None 2026-05-04 16:57:20,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:57:20,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 16:57:20,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:57:20,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62cec8234569b79a1ed61 HTTP/1.1" 200 None 2026-05-04 16:57:20,118 - lava_callback - ERROR - Error processing callback for node 69f62cec8234569b79a1ed61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK 2026-05-04 16:58:45,093 - lava_callback - INFO - Received callback for node 69f62d348234569b79a1ed79 INFO: 172.20.0.1:58058 - "POST /node/69f62d348234569b79a1ed79 HTTP/1.0" 202 Accepted 2026-05-04 16:58:45,099 - lava_callback - INFO - Starting async job submit for node 69f62d348234569b79a1ed79 2026-05-04 16:58:45,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:58:45,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62d348234569b79a1ed79 HTTP/1.1" 200 None 2026-05-04 16:58:45,114 - lava_callback - DEBUG - Processing node 69f62d348234569b79a1ed79: baseline-arm-clabbe 2026-05-04 16:58:45,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62d348234569b79a1ed79 2026-05-04 16:58:45,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:58:45,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62d348234569b79a1ed79 HTTP/1.1" 200 None 2026-05-04 16:58:45,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:58:45,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 16:58:45,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 16:58:45,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62d348234569b79a1ed79 HTTP/1.1" 200 None 2026-05-04 16:58:45,158 - lava_callback - ERROR - Error processing callback for node 69f62d348234569b79a1ed79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:05:06,487 - lava_callback - INFO - Received callback for node 69f8d1b50573a8210e130012 INFO: 172.20.0.1:37530 - "POST /node/69f8d1b50573a8210e130012 HTTP/1.0" 202 Accepted 2026-05-04 17:05:06,493 - lava_callback - INFO - Starting async job submit for node 69f8d1b50573a8210e130012 2026-05-04 17:05:06,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:06,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b50573a8210e130012 HTTP/1.1" 200 None 2026-05-04 17:05:06,520 - lava_callback - DEBUG - Processing node 69f8d1b50573a8210e130012: baseline-arm64 2026-05-04 17:05:06,525 - lava_callback - WARNING - Failed to upload log INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:05:06,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:06,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:06,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b50573a8210e130012/lava-logs.yaml 2026-05-04 17:05:06,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:06,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:06,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b50573a8210e130012/lava_callback.json.gz 2026-05-04 17:05:06,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:06,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b50573a8210e130012 HTTP/1.1" 200 None 2026-05-04 17:05:06,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:06,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:05:06,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:06,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1b50573a8210e130012 HTTP/1.1" 200 None 2026-05-04 17:05:06,838 - lava_callback - INFO - Completed processing callback for node 69f8d1b50573a8210e130012 INFO: 172.20.0.1:40108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36890 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:05:27,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:27,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:05:39,560 - lava_callback - INFO - Received callback for node 69f8d1c10573a8210e130034 INFO: 172.20.0.1:33004 - "POST /node/69f8d1c10573a8210e130034 HTTP/1.0" 202 Accepted 2026-05-04 17:05:39,577 - lava_callback - INFO - Starting async job submit for node 69f8d1c10573a8210e130034 2026-05-04 17:05:39,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:39,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c10573a8210e130034 HTTP/1.1" 200 None 2026-05-04 17:05:39,624 - lava_callback - DEBUG - Processing node 69f8d1c10573a8210e130034: baseline-arm64 2026-05-04 17:05:39,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:39,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:39,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c10573a8210e130034/log.txt.gz 2026-05-04 17:05:39,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:40,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:40,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c10573a8210e130034/lava-logs.yaml 2026-05-04 17:05:40,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:40,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:40,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c10573a8210e130034/lava_callback.json.gz 2026-05-04 17:05:40,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:40,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c10573a8210e130034 HTTP/1.1" 200 None 2026-05-04 17:05:40,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:40,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:05:40,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:40,331 - lava_callback - INFO - Received callback for node 69f8d1d00573a8210e130060 2026-05-04 17:05:40,348 - lava_callback - INFO - Starting async job submit for node 69f8d1d00573a8210e130060 INFO: 172.20.0.1:52072 - "POST /node/69f8d1d00573a8210e130060 HTTP/1.0" 202 Accepted 2026-05-04 17:05:40,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:40,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c10573a8210e130034 HTTP/1.1" 200 None 2026-05-04 17:05:40,357 - lava_callback - INFO - Completed processing callback for node 69f8d1c10573a8210e130034 2026-05-04 17:05:40,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d00573a8210e130060 HTTP/1.1" 200 None 2026-05-04 17:05:40,388 - lava_callback - DEBUG - Processing node 69f8d1d00573a8210e130060: baseline-nfs-arm64 2026-05-04 17:05:40,391 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:05:40,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:40,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:40,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d00573a8210e130060/lava-logs.yaml 2026-05-04 17:05:40,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:40,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:40,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d00573a8210e130060/lava_callback.json.gz 2026-05-04 17:05:40,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:40,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d00573a8210e130060 HTTP/1.1" 200 None 2026-05-04 17:05:40,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:40,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:05:40,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:40,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d00573a8210e130060 HTTP/1.1" 200 None 2026-05-04 17:05:40,645 - lava_callback - INFO - Completed processing callback for node 69f8d1d00573a8210e130060 2026-05-04 17:05:42,685 - lava_callback - INFO - Received callback for node 69f8cda90573a8210e12facb INFO: 172.20.0.1:52078 - "POST /node/69f8cda90573a8210e12facb HTTP/1.0" 202 Accepted 2026-05-04 17:05:42,693 - lava_callback - INFO - Starting async job submit for node 69f8cda90573a8210e12facb 2026-05-04 17:05:42,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:42,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda90573a8210e12facb HTTP/1.1" 200 None 2026-05-04 17:05:42,794 - lava_callback - DEBUG - Processing node 69f8cda90573a8210e12facb: baseline-arm 2026-05-04 17:05:43,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:43,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:43,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda90573a8210e12facb/log.txt.gz 2026-05-04 17:05:44,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:44,271 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:44,273 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda90573a8210e12facb/lava-logs.yaml 2026-05-04 17:05:44,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:05:44,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:05:44,408 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8cda90573a8210e12facb/lava_callback.json.gz DEBUG: Setup failed for 69f8cda90573a8210e12facb. Transitting job node result: incomplete -> fail 2026-05-04 17:05:44,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:44,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cda90573a8210e12facb HTTP/1.1" 200 None 2026-05-04 17:05:44,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:44,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 17:05:44,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:44,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cda90573a8210e12facb HTTP/1.1" 200 None 2026-05-04 17:05:44,739 - lava_callback - INFO - Completed processing callback for node 69f8cda90573a8210e12facb INFO: 172.20.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38670 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:05:57,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:05:57,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:06:05,156 - lava_callback - INFO - Received callback for node 69f8d1c20573a8210e130037 INFO: 172.20.0.1:57522 - "POST /node/69f8d1c20573a8210e130037 HTTP/1.0" 202 Accepted 2026-05-04 17:06:05,163 - lava_callback - INFO - Starting async job submit for node 69f8d1c20573a8210e130037 2026-05-04 17:06:05,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:05,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c20573a8210e130037 HTTP/1.1" 200 None 2026-05-04 17:06:05,208 - lava_callback - DEBUG - Processing node 69f8d1c20573a8210e130037: baseline-arm64 2026-05-04 17:06:05,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:05,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:05,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c20573a8210e130037/log.txt.gz 2026-05-04 17:06:05,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:06,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:06,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c20573a8210e130037/lava-logs.yaml 2026-05-04 17:06:06,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:06,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:06,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c20573a8210e130037/lava_callback.json.gz 2026-05-04 17:06:06,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:06,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c20573a8210e130037 HTTP/1.1" 200 None 2026-05-04 17:06:06,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:06,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:06,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:06,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c20573a8210e130037 HTTP/1.1" 200 None 2026-05-04 17:06:06,306 - lava_callback - INFO - Completed processing callback for node 69f8d1c20573a8210e130037 INFO: 172.20.0.1:57524 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:06:14,273 - lava_callback - INFO - Received callback for node 69f8d1b70573a8210e130018 INFO: 172.20.0.1:41840 - "POST /node/69f8d1b70573a8210e130018 HTTP/1.0" 202 Accepted 2026-05-04 17:06:14,279 - lava_callback - INFO - Starting async job submit for node 69f8d1b70573a8210e130018 2026-05-04 17:06:14,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:14,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b70573a8210e130018 HTTP/1.1" 200 None 2026-05-04 17:06:14,315 - lava_callback - DEBUG - Processing node 69f8d1b70573a8210e130018: baseline-arm64 2026-05-04 17:06:14,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:14,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:14,685 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b70573a8210e130018/log.txt.gz 2026-05-04 17:06:14,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:15,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:15,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b70573a8210e130018/lava-logs.yaml 2026-05-04 17:06:15,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:15,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:15,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b70573a8210e130018/lava_callback.json.gz INFO: 172.20.0.1:41850 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 17:06:15,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:15,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b70573a8210e130018 HTTP/1.1" 200 None 2026-05-04 17:06:15,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:15,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:15,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:15,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1b70573a8210e130018 HTTP/1.1" 200 None 2026-05-04 17:06:15,264 - lava_callback - INFO - Completed processing callback for node 69f8d1b70573a8210e130018 INFO: 172.20.0.1:41862 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:06:17,904 - lava_callback - INFO - Received callback for node 69f8d1b90573a8210e13001f INFO: 172.20.0.1:41878 - "POST /node/69f8d1b90573a8210e13001f HTTP/1.0" 202 Accepted 2026-05-04 17:06:17,911 - lava_callback - INFO - Starting async job submit for node 69f8d1b90573a8210e13001f 2026-05-04 17:06:17,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:17,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b90573a8210e13001f HTTP/1.1" 200 None 2026-05-04 17:06:17,963 - lava_callback - DEBUG - Processing node 69f8d1b90573a8210e13001f: baseline-arm64 2026-05-04 17:06:18,110 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:06:18,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:18,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:18,294 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b90573a8210e13001f/lava-logs.yaml 2026-05-04 17:06:18,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:18,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:18,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b90573a8210e13001f/lava_callback.json.gz 2026-05-04 17:06:18,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:18,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b90573a8210e13001f HTTP/1.1" 200 None 2026-05-04 17:06:18,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:18,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:18,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:18,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1b90573a8210e13001f HTTP/1.1" 200 None 2026-05-04 17:06:18,544 - lava_callback - INFO - Completed processing callback for node 69f8d1b90573a8210e13001f 2026-05-04 17:06:18,610 - lava_callback - INFO - Received callback for node 69f8d1ba0573a8210e130022 INFO: 172.20.0.1:41890 - "POST /node/69f8d1ba0573a8210e130022 HTTP/1.0" 202 Accepted 2026-05-04 17:06:18,629 - lava_callback - INFO - Starting async job submit for node 69f8d1ba0573a8210e130022 2026-05-04 17:06:18,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:18,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ba0573a8210e130022 HTTP/1.1" 200 None 2026-05-04 17:06:18,710 - lava_callback - DEBUG - Processing node 69f8d1ba0573a8210e130022: baseline-arm64 2026-05-04 17:06:18,804 - lava_callback - INFO - Received callback for node 69f8d1bc0573a8210e130028 INFO: 172.20.0.1:41896 - "POST /node/69f8d1bc0573a8210e130028 HTTP/1.0" 202 Accepted 2026-05-04 17:06:18,826 - lava_callback - INFO - Starting async job submit for node 69f8d1bc0573a8210e130028 2026-05-04 17:06:18,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:18,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bc0573a8210e130028 HTTP/1.1" 200 None 2026-05-04 17:06:18,981 - lava_callback - DEBUG - Processing node 69f8d1bc0573a8210e130028: baseline-arm64 2026-05-04 17:06:19,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:19,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:19,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1ba0573a8210e130022/log.txt.gz 2026-05-04 17:06:19,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:19,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:19,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:19,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bc0573a8210e130028/log.txt.gz 2026-05-04 17:06:19,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:19,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1ba0573a8210e130022/lava-logs.yaml 2026-05-04 17:06:19,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:19,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:19,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:19,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1ba0573a8210e130022/lava_callback.json.gz 2026-05-04 17:06:19,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:19,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ba0573a8210e130022 HTTP/1.1" 200 None 2026-05-04 17:06:19,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:19,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:19,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bc0573a8210e130028/lava-logs.yaml 2026-05-04 17:06:19,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:19,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:19,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:19,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1ba0573a8210e130022 HTTP/1.1" 200 None 2026-05-04 17:06:20,005 - lava_callback - INFO - Completed processing callback for node 69f8d1ba0573a8210e130022 2026-05-04 17:06:20,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:20,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bc0573a8210e130028/lava_callback.json.gz 2026-05-04 17:06:20,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:20,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bc0573a8210e130028 HTTP/1.1" 200 None 2026-05-04 17:06:20,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:20,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:20,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:20,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1bc0573a8210e130028 HTTP/1.1" 200 None 2026-05-04 17:06:20,243 - lava_callback - INFO - Completed processing callback for node 69f8d1bc0573a8210e130028 INFO: 172.20.0.1:43408 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:06:23,724 - lava_callback - INFO - Received callback for node 69f8d1bf0573a8210e13002e INFO: 172.20.0.1:43424 - "POST /node/69f8d1bf0573a8210e13002e HTTP/1.0" 202 Accepted 2026-05-04 17:06:23,730 - lava_callback - INFO - Starting async job submit for node 69f8d1bf0573a8210e13002e 2026-05-04 17:06:23,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:23,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bf0573a8210e13002e HTTP/1.1" 200 None 2026-05-04 17:06:23,773 - lava_callback - DEBUG - Processing node 69f8d1bf0573a8210e13002e: baseline-arm64 2026-05-04 17:06:24,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:24,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:24,361 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bf0573a8210e13002e/log.txt.gz 2026-05-04 17:06:24,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:24,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:24,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bf0573a8210e13002e/lava-logs.yaml 2026-05-04 17:06:24,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:24,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:24,876 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bf0573a8210e13002e/lava_callback.json.gz 2026-05-04 17:06:24,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:24,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bf0573a8210e13002e HTTP/1.1" 200 None 2026-05-04 17:06:24,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:24,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:24,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:24,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1bf0573a8210e13002e HTTP/1.1" 200 None 2026-05-04 17:06:24,955 - lava_callback - INFO - Completed processing callback for node 69f8d1bf0573a8210e13002e 2026-05-04 17:06:25,297 - lava_callback - INFO - Received callback for node 69f62f0d8234569b79a1ee61 INFO: 172.20.0.1:43440 - "POST /node/69f62f0d8234569b79a1ee61 HTTP/1.0" 202 Accepted 2026-05-04 17:06:25,307 - lava_callback - INFO - Starting async job submit for node 69f62f0d8234569b79a1ee61 2026-05-04 17:06:25,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:25,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62f0d8234569b79a1ee61 HTTP/1.1" 200 None 2026-05-04 17:06:25,324 - lava_callback - DEBUG - Processing node 69f62f0d8234569b79a1ee61: baseline-arm-clabbe 2026-05-04 17:06:25,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62f0d8234569b79a1ee61 2026-05-04 17:06:25,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:25,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62f0d8234569b79a1ee61 HTTP/1.1" 200 None 2026-05-04 17:06:25,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:25,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 17:06:25,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:25,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62f0d8234569b79a1ee61 HTTP/1.1" 200 None 2026-05-04 17:06:25,389 - lava_callback - ERROR - Error processing callback for node 69f62f0d8234569b79a1ee61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43444 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:06:27,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:27,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-04 17:06:28,220 - lava_callback - INFO - Received callback for node 69f8d1c50573a8210e130042 INFO: 172.20.0.1:43450 - "POST /node/69f8d1c50573a8210e130042 HTTP/1.0" 202 Accepted 2026-05-04 17:06:28,226 - lava_callback - INFO - Starting async job submit for node 69f8d1c50573a8210e130042 2026-05-04 17:06:28,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:28,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c50573a8210e130042 HTTP/1.1" 200 None 2026-05-04 17:06:28,270 - lava_callback - DEBUG - Processing node 69f8d1c50573a8210e130042: baseline-arm64 2026-05-04 17:06:28,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:28,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:28,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c50573a8210e130042/log.txt.gz 2026-05-04 17:06:28,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:29,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:29,128 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c50573a8210e130042/lava-logs.yaml 2026-05-04 17:06:29,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:29,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:29,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c50573a8210e130042/lava_callback.json.gz 2026-05-04 17:06:29,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:29,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c50573a8210e130042 HTTP/1.1" 200 None 2026-05-04 17:06:29,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:29,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:29,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:29,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c50573a8210e130042 HTTP/1.1" 200 None 2026-05-04 17:06:29,332 - lava_callback - INFO - Completed processing callback for node 69f8d1c50573a8210e130042 2026-05-04 17:06:29,439 - lava_callback - INFO - Received callback for node 69f8d1bd0573a8210e13002b INFO: 172.20.0.1:43460 - "POST /node/69f8d1bd0573a8210e13002b HTTP/1.0" 202 Accepted 2026-05-04 17:06:29,448 - lava_callback - INFO - Starting async job submit for node 69f8d1bd0573a8210e13002b 2026-05-04 17:06:29,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:29,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bd0573a8210e13002b HTTP/1.1" 200 None 2026-05-04 17:06:29,500 - lava_callback - DEBUG - Processing node 69f8d1bd0573a8210e13002b: baseline-arm64 2026-05-04 17:06:29,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:30,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:30,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bd0573a8210e13002b/log.txt.gz 2026-05-04 17:06:30,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:30,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:30,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bd0573a8210e13002b/lava-logs.yaml 2026-05-04 17:06:30,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:30,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:30,499 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bd0573a8210e13002b/lava_callback.json.gz 2026-05-04 17:06:30,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:30,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bd0573a8210e13002b HTTP/1.1" 200 None 2026-05-04 17:06:30,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:30,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:30,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:30,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1bd0573a8210e13002b HTTP/1.1" 200 None 2026-05-04 17:06:30,583 - lava_callback - INFO - Completed processing callback for node 69f8d1bd0573a8210e13002b 2026-05-04 17:06:35,673 - lava_callback - INFO - Received callback for node 69f8d1c70573a8210e130045 INFO: 172.20.0.1:59596 - "POST /node/69f8d1c70573a8210e130045 HTTP/1.0" 202 Accepted 2026-05-04 17:06:35,683 - lava_callback - INFO - Starting async job submit for node 69f8d1c70573a8210e130045 2026-05-04 17:06:35,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:35,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c70573a8210e130045 HTTP/1.1" 200 None 2026-05-04 17:06:35,745 - lava_callback - DEBUG - Processing node 69f8d1c70573a8210e130045: baseline-arm64 2026-05-04 17:06:35,981 - lava_callback - INFO - Received callback for node 69f8d1c00573a8210e130031 INFO: 172.20.0.1:59612 - "POST /node/69f8d1c00573a8210e130031 HTTP/1.0" 202 Accepted 2026-05-04 17:06:36,006 - lava_callback - INFO - Starting async job submit for node 69f8d1c00573a8210e130031 2026-05-04 17:06:36,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:36,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c00573a8210e130031 HTTP/1.1" 200 None 2026-05-04 17:06:36,167 - lava_callback - DEBUG - Processing node 69f8d1c00573a8210e130031: baseline-arm64 2026-05-04 17:06:36,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:36,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:36,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c70573a8210e130045/log.txt.gz INFO: 172.20.0.1:59620 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:06:36,984 - lava_callback - INFO - Received callback for node 69f8d1c40573a8210e13003f 2026-05-04 17:06:37,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:37,016 - lava_callback - INFO - Starting async job submit for node 69f8d1c40573a8210e13003f INFO: 172.20.0.1:59634 - "POST /node/69f8d1c40573a8210e13003f HTTP/1.0" 202 Accepted 2026-05-04 17:06:37,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:37,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:37,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c40573a8210e13003f HTTP/1.1" 200 None 2026-05-04 17:06:37,105 - lava_callback - DEBUG - Processing node 69f8d1c40573a8210e13003f: baseline-arm64 2026-05-04 17:06:37,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:37,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:37,315 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c00573a8210e130031/log.txt.gz 2026-05-04 17:06:37,337 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c70573a8210e130045/lava-logs.yaml 2026-05-04 17:06:37,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:37,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:37,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:37,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:37,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c40573a8210e13003f/log.txt.gz 2026-05-04 17:06:37,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c70573a8210e130045/lava_callback.json.gz 2026-05-04 17:06:37,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:37,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:37,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c70573a8210e130045 HTTP/1.1" 200 None 2026-05-04 17:06:37,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:37,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:37,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:37,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:37,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c70573a8210e130045 HTTP/1.1" 200 None 2026-05-04 17:06:37,946 - lava_callback - INFO - Completed processing callback for node 69f8d1c70573a8210e130045 2026-05-04 17:06:38,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:38,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c00573a8210e130031/lava-logs.yaml 2026-05-04 17:06:38,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:38,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:38,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c40573a8210e13003f/lava-logs.yaml 2026-05-04 17:06:38,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:38,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:38,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c00573a8210e130031/lava_callback.json.gz 2026-05-04 17:06:38,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:38,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c00573a8210e130031 HTTP/1.1" 200 None 2026-05-04 17:06:38,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:38,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:38,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:38,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:38,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c40573a8210e13003f/lava_callback.json.gz 2026-05-04 17:06:38,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:38,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c00573a8210e130031 HTTP/1.1" 200 None 2026-05-04 17:06:38,252 - lava_callback - INFO - Completed processing callback for node 69f8d1c00573a8210e130031 2026-05-04 17:06:38,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c40573a8210e13003f HTTP/1.1" 200 None 2026-05-04 17:06:38,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:38,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:38,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:38,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c40573a8210e13003f HTTP/1.1" 200 None 2026-05-04 17:06:38,342 - lava_callback - INFO - Completed processing callback for node 69f8d1c40573a8210e13003f 2026-05-04 17:06:42,258 - lava_callback - INFO - Received callback for node 69f8d1d40573a8210e1300a0 INFO: 172.20.0.1:50134 - "POST /node/69f8d1d40573a8210e1300a0 HTTP/1.0" 202 Accepted 2026-05-04 17:06:42,265 - lava_callback - INFO - Starting async job submit for node 69f8d1d40573a8210e1300a0 2026-05-04 17:06:42,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:42,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d40573a8210e1300a0 HTTP/1.1" 200 None 2026-05-04 17:06:42,318 - lava_callback - DEBUG - Processing node 69f8d1d40573a8210e1300a0: baseline-nfs-arm64 2026-05-04 17:06:42,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:42,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:42,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d40573a8210e1300a0/log.txt.gz 2026-05-04 17:06:43,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:43,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:43,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d40573a8210e1300a0/lava-logs.yaml 2026-05-04 17:06:43,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:43,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:43,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d40573a8210e1300a0/lava_callback.json.gz 2026-05-04 17:06:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d40573a8210e1300a0 HTTP/1.1" 200 None 2026-05-04 17:06:43,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:43,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:43,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:43,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d40573a8210e1300a0 HTTP/1.1" 200 None 2026-05-04 17:06:43,411 - lava_callback - INFO - Completed processing callback for node 69f8d1d40573a8210e1300a0 2026-05-04 17:06:44,570 - lava_callback - INFO - Received callback for node 69f8d1b60573a8210e130015 INFO: 172.20.0.1:50150 - "POST /node/69f8d1b60573a8210e130015 HTTP/1.0" 202 Accepted 2026-05-04 17:06:44,576 - lava_callback - INFO - Starting async job submit for node 69f8d1b60573a8210e130015 2026-05-04 17:06:44,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:44,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b60573a8210e130015 HTTP/1.1" 200 None 2026-05-04 17:06:44,611 - lava_callback - DEBUG - Processing node 69f8d1b60573a8210e130015: baseline-arm64 2026-05-04 17:06:44,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:44,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:44,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b60573a8210e130015/log.txt.gz 2026-05-04 17:06:45,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:45,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:45,365 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b60573a8210e130015/lava-logs.yaml 2026-05-04 17:06:45,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:45,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:45,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b60573a8210e130015/lava_callback.json.gz 2026-05-04 17:06:45,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:45,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b60573a8210e130015 HTTP/1.1" 200 None 2026-05-04 17:06:45,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:45,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:45,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:45,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1b60573a8210e130015 HTTP/1.1" 200 None 2026-05-04 17:06:45,550 - lava_callback - INFO - Completed processing callback for node 69f8d1b60573a8210e130015 2026-05-04 17:06:46,238 - lava_callback - INFO - Received callback for node 69f8d1b80573a8210e13001c INFO: 172.20.0.1:50154 - "POST /node/69f8d1b80573a8210e13001c HTTP/1.0" 202 Accepted 2026-05-04 17:06:46,245 - lava_callback - INFO - Starting async job submit for node 69f8d1b80573a8210e13001c 2026-05-04 17:06:46,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:46,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b80573a8210e13001c HTTP/1.1" 200 None 2026-05-04 17:06:46,287 - lava_callback - DEBUG - Processing node 69f8d1b80573a8210e13001c: baseline-arm64 INFO: 172.20.0.1:50168 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:06:46,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:46,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:46,675 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b80573a8210e13001c/log.txt.gz 2026-05-04 17:06:46,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:46,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:46,962 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b80573a8210e13001c/lava-logs.yaml 2026-05-04 17:06:46,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:47,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:47,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1b80573a8210e13001c/lava_callback.json.gz 2026-05-04 17:06:47,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:47,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1b80573a8210e13001c HTTP/1.1" 200 None 2026-05-04 17:06:47,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:47,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:47,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:47,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1b80573a8210e13001c HTTP/1.1" 200 None 2026-05-04 17:06:47,160 - lava_callback - INFO - Completed processing callback for node 69f8d1b80573a8210e13001c 2026-05-04 17:06:52,641 - lava_callback - INFO - Received callback for node 69f8d1d10573a8210e130095 INFO: 172.20.0.1:60706 - "POST /node/69f8d1d10573a8210e130095 HTTP/1.0" 202 Accepted 2026-05-04 17:06:52,648 - lava_callback - INFO - Starting async job submit for node 69f8d1d10573a8210e130095 2026-05-04 17:06:52,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:52,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d10573a8210e130095 HTTP/1.1" 200 None 2026-05-04 17:06:52,688 - lava_callback - DEBUG - Processing node 69f8d1d10573a8210e130095: baseline-nfs-arm64 2026-05-04 17:06:53,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:53,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:53,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d10573a8210e130095/log.txt.gz 2026-05-04 17:06:53,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:53,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:53,522 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d10573a8210e130095/lava-logs.yaml 2026-05-04 17:06:53,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:53,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:53,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d10573a8210e130095/lava_callback.json.gz 2026-05-04 17:06:53,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:53,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d10573a8210e130095 HTTP/1.1" 200 None 2026-05-04 17:06:53,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:53,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:53,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:53,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d10573a8210e130095 HTTP/1.1" 200 None 2026-05-04 17:06:53,695 - lava_callback - INFO - Completed processing callback for node 69f8d1d10573a8210e130095 2026-05-04 17:06:54,135 - lava_callback - INFO - Received callback for node 69f8d1ce0573a8210e13005a INFO: 172.20.0.1:60716 - "POST /node/69f8d1ce0573a8210e13005a HTTP/1.0" 202 Accepted 2026-05-04 17:06:54,142 - lava_callback - INFO - Starting async job submit for node 69f8d1ce0573a8210e13005a 2026-05-04 17:06:54,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:54,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ce0573a8210e13005a HTTP/1.1" 200 None 2026-05-04 17:06:54,188 - lava_callback - DEBUG - Processing node 69f8d1ce0573a8210e13005a: baseline-nfs-arm64 2026-05-04 17:06:54,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:54,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:54,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1ce0573a8210e13005a/log.txt.gz 2026-05-04 17:06:55,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:55,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:55,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1ce0573a8210e13005a/lava-logs.yaml 2026-05-04 17:06:55,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:55,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:55,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1ce0573a8210e13005a/lava_callback.json.gz 2026-05-04 17:06:55,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:55,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ce0573a8210e13005a HTTP/1.1" 200 None 2026-05-04 17:06:55,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:55,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:06:55,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:55,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1ce0573a8210e13005a HTTP/1.1" 200 None 2026-05-04 17:06:55,664 - lava_callback - INFO - Completed processing callback for node 69f8d1ce0573a8210e13005a INFO: 172.20.0.1:60732 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:06:57,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:57,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-04 17:06:58,921 - lava_callback - INFO - Received callback for node 69f8d1cb0573a8210e130053 INFO: 172.20.0.1:60746 - "POST /node/69f8d1cb0573a8210e130053 HTTP/1.0" 202 Accepted 2026-05-04 17:06:58,932 - lava_callback - INFO - Starting async job submit for node 69f8d1cb0573a8210e130053 2026-05-04 17:06:58,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:58,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1cb0573a8210e130053 HTTP/1.1" 200 None 2026-05-04 17:06:58,991 - lava_callback - DEBUG - Processing node 69f8d1cb0573a8210e130053: baseline-nfs-arm64 2026-05-04 17:06:59,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:59,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:59,434 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cb0573a8210e130053/log.txt.gz 2026-05-04 17:06:59,614 - lava_callback - INFO - Received callback for node 69f8d1d30573a8210e13009d INFO: 172.20.0.1:60760 - "POST /node/69f8d1d30573a8210e13009d HTTP/1.0" 202 Accepted 2026-05-04 17:06:59,628 - lava_callback - INFO - Starting async job submit for node 69f8d1d30573a8210e13009d 2026-05-04 17:06:59,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:06:59,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:06:59,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d30573a8210e13009d HTTP/1.1" 200 None 2026-05-04 17:06:59,667 - lava_callback - DEBUG - Processing node 69f8d1d30573a8210e13009d: baseline-nfs-arm64 2026-05-04 17:06:59,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:06:59,844 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cb0573a8210e130053/lava-logs.yaml 2026-05-04 17:06:59,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:00,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:00,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:00,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cb0573a8210e130053/lava_callback.json.gz 2026-05-04 17:07:00,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:00,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:00,150 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d30573a8210e13009d/log.txt.gz 2026-05-04 17:07:00,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1cb0573a8210e130053 HTTP/1.1" 200 None 2026-05-04 17:07:00,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:00,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:00,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:00,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:00,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1cb0573a8210e130053 HTTP/1.1" 200 None 2026-05-04 17:07:00,358 - lava_callback - INFO - Completed processing callback for node 69f8d1cb0573a8210e130053 2026-05-04 17:07:00,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:00,554 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d30573a8210e13009d/lava-logs.yaml 2026-05-04 17:07:00,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:00,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:00,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d30573a8210e13009d/lava_callback.json.gz 2026-05-04 17:07:00,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:00,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d30573a8210e13009d HTTP/1.1" 200 None 2026-05-04 17:07:00,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:00,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:00,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:00,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d30573a8210e13009d HTTP/1.1" 200 None 2026-05-04 17:07:00,747 - lava_callback - INFO - Completed processing callback for node 69f8d1d30573a8210e13009d 2026-05-04 17:07:03,934 - lava_callback - INFO - Received callback for node 69f8d1fc0573a8210e13012f INFO: 172.20.0.1:44560 - "POST /node/69f8d1fc0573a8210e13012f HTTP/1.0" 202 Accepted 2026-05-04 17:07:03,940 - lava_callback - INFO - Starting async job submit for node 69f8d1fc0573a8210e13012f 2026-05-04 17:07:03,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:03,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fc0573a8210e13012f HTTP/1.1" 200 None 2026-05-04 17:07:03,994 - lava_callback - DEBUG - Processing node 69f8d1fc0573a8210e13012f: baseline-arm64-foundriesio 2026-05-04 17:07:04,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:04,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:04,342 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d1fc0573a8210e13012f/log.txt.gz 2026-05-04 17:07:04,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:04,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:04,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d1fc0573a8210e13012f/lava-logs.yaml 2026-05-04 17:07:04,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:04,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:04,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d1fc0573a8210e13012f/lava_callback.json.gz 2026-05-04 17:07:04,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:04,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fc0573a8210e13012f HTTP/1.1" 200 None 2026-05-04 17:07:04,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:04,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:04,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:04,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1fc0573a8210e13012f HTTP/1.1" 200 None 2026-05-04 17:07:04,896 - lava_callback - INFO - Completed processing callback for node 69f8d1fc0573a8210e13012f 2026-05-04 17:07:05,438 - lava_callback - INFO - Received callback for node 69f8d1d60573a8210e1300a3 INFO: 172.20.0.1:44576 - "POST /node/69f8d1d60573a8210e1300a3 HTTP/1.0" 202 Accepted 2026-05-04 17:07:05,445 - lava_callback - INFO - Starting async job submit for node 69f8d1d60573a8210e1300a3 2026-05-04 17:07:05,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:05,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d60573a8210e1300a3 HTTP/1.1" 200 None 2026-05-04 17:07:05,485 - lava_callback - DEBUG - Processing node 69f8d1d60573a8210e1300a3: baseline-nfs-arm64 2026-05-04 17:07:05,831 - lava_callback - INFO - Received callback for node 69f8d1cf0573a8210e13005d INFO: 172.20.0.1:44578 - "POST /node/69f8d1cf0573a8210e13005d HTTP/1.0" 202 Accepted 2026-05-04 17:07:05,862 - lava_callback - INFO - Starting async job submit for node 69f8d1cf0573a8210e13005d 2026-05-04 17:07:05,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:06,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1cf0573a8210e13005d HTTP/1.1" 200 None 2026-05-04 17:07:06,011 - lava_callback - DEBUG - Processing node 69f8d1cf0573a8210e13005d: baseline-nfs-arm64 2026-05-04 17:07:06,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:06,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:06,469 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d60573a8210e1300a3/log.txt.gz INFO: 172.20.0.1:44582 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:07:07,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:07,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:07,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cf0573a8210e13005d/log.txt.gz 2026-05-04 17:07:07,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:07,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d60573a8210e1300a3/lava-logs.yaml 2026-05-04 17:07:07,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:07,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:07,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:07,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d60573a8210e1300a3/lava_callback.json.gz 2026-05-04 17:07:07,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:07,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d60573a8210e1300a3 HTTP/1.1" 200 None 2026-05-04 17:07:07,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:07,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:07,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:07,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d60573a8210e1300a3 HTTP/1.1" 200 None 2026-05-04 17:07:07,652 - lava_callback - INFO - Completed processing callback for node 69f8d1d60573a8210e1300a3 2026-05-04 17:07:07,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:07,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cf0573a8210e13005d/lava-logs.yaml 2026-05-04 17:07:07,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:07,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:07,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cf0573a8210e13005d/lava_callback.json.gz 2026-05-04 17:07:07,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:07,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1cf0573a8210e13005d HTTP/1.1" 200 None 2026-05-04 17:07:07,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:08,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:08,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:08,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1cf0573a8210e13005d HTTP/1.1" 200 None 2026-05-04 17:07:08,027 - lava_callback - INFO - Completed processing callback for node 69f8d1cf0573a8210e13005d 2026-05-04 17:07:08,811 - lava_callback - INFO - Received callback for node 69f8d1c90573a8210e13004d INFO: 172.20.0.1:44598 - "POST /node/69f8d1c90573a8210e13004d HTTP/1.0" 202 Accepted 2026-05-04 17:07:08,822 - lava_callback - INFO - Starting async job submit for node 69f8d1c90573a8210e13004d 2026-05-04 17:07:08,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:08,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c90573a8210e13004d HTTP/1.1" 200 None 2026-05-04 17:07:08,879 - lava_callback - DEBUG - Processing node 69f8d1c90573a8210e13004d: baseline-nfs-arm64 2026-05-04 17:07:09,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:09,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:09,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1c90573a8210e13004d/log.txt.gz 2026-05-04 17:07:09,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:09,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:09,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1c90573a8210e13004d/lava-logs.yaml 2026-05-04 17:07:09,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:09,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:09,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1c90573a8210e13004d/lava_callback.json.gz 2026-05-04 17:07:09,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:09,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c90573a8210e13004d HTTP/1.1" 200 None 2026-05-04 17:07:09,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:09,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:09,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:09,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c90573a8210e13004d HTTP/1.1" 200 None 2026-05-04 17:07:09,857 - lava_callback - INFO - Completed processing callback for node 69f8d1c90573a8210e13004d 2026-05-04 17:07:11,271 - lava_callback - INFO - Received callback for node 69f8d1f90573a8210e130126 INFO: 172.20.0.1:59522 - "POST /node/69f8d1f90573a8210e130126 HTTP/1.0" 202 Accepted 2026-05-04 17:07:11,278 - lava_callback - INFO - Starting async job submit for node 69f8d1f90573a8210e130126 2026-05-04 17:07:11,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:11,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f90573a8210e130126 HTTP/1.1" 200 None 2026-05-04 17:07:11,316 - lava_callback - DEBUG - Processing node 69f8d1f90573a8210e130126: baseline-arm64-pengutronix 2026-05-04 17:07:11,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:11,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:11,670 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1f90573a8210e130126/log.txt.gz 2026-05-04 17:07:11,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:11,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:11,952 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1f90573a8210e130126/lava-logs.yaml 2026-05-04 17:07:11,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:12,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:12,065 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1f90573a8210e130126/lava_callback.json.gz 2026-05-04 17:07:12,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:12,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f90573a8210e130126 HTTP/1.1" 200 None 2026-05-04 17:07:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:12,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:12,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:12,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f90573a8210e130126 HTTP/1.1" 200 None 2026-05-04 17:07:12,151 - lava_callback - INFO - Completed processing callback for node 69f8d1f90573a8210e130126 INFO: 172.20.0.1:59534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59536 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:07:19,736 - lava_callback - INFO - Received callback for node 69f8d1fa0573a8210e130129 INFO: 172.20.0.1:36538 - "POST /node/69f8d1fa0573a8210e130129 HTTP/1.0" 202 Accepted 2026-05-04 17:07:19,742 - lava_callback - INFO - Starting async job submit for node 69f8d1fa0573a8210e130129 2026-05-04 17:07:19,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:19,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fa0573a8210e130129 HTTP/1.1" 200 None 2026-05-04 17:07:19,778 - lava_callback - DEBUG - Processing node 69f8d1fa0573a8210e130129: baseline-arm64-pengutronix 2026-05-04 17:07:19,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:20,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:20,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1fa0573a8210e130129/log.txt.gz 2026-05-04 17:07:20,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:20,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:20,298 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1fa0573a8210e130129/lava-logs.yaml 2026-05-04 17:07:20,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:20,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:20,409 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1fa0573a8210e130129/lava_callback.json.gz 2026-05-04 17:07:20,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:20,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fa0573a8210e130129 HTTP/1.1" 200 None 2026-05-04 17:07:20,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:20,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:20,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:20,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1fa0573a8210e130129 HTTP/1.1" 200 None 2026-05-04 17:07:20,498 - lava_callback - INFO - Completed processing callback for node 69f8d1fa0573a8210e130129 INFO: 172.20.0.1:36546 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:07:24,097 - lava_callback - INFO - Received callback for node 69f8d1f70573a8210e130123 INFO: 172.20.0.1:36558 - "POST /node/69f8d1f70573a8210e130123 HTTP/1.0" 202 Accepted 2026-05-04 17:07:24,108 - lava_callback - INFO - Starting async job submit for node 69f8d1f70573a8210e130123 2026-05-04 17:07:24,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:24,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f70573a8210e130123 HTTP/1.1" 200 None 2026-05-04 17:07:24,149 - lava_callback - DEBUG - Processing node 69f8d1f70573a8210e130123: baseline-arm64-kontron 2026-05-04 17:07:24,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:24,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:24,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f8d1f70573a8210e130123/log.txt.gz 2026-05-04 17:07:24,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:24,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:24,991 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f8d1f70573a8210e130123/lava-logs.yaml 2026-05-04 17:07:24,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:25,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:25,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69f8d1f70573a8210e130123/lava_callback.json.gz 2026-05-04 17:07:25,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:25,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f70573a8210e130123 HTTP/1.1" 200 None 2026-05-04 17:07:25,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:25,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:25,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:25,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f70573a8210e130123 HTTP/1.1" 200 None 2026-05-04 17:07:25,172 - lava_callback - INFO - Completed processing callback for node 69f8d1f70573a8210e130123 INFO: 172.20.0.1:36564 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:07:27,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:27,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-04 17:07:27,522 - lava_callback - INFO - Received callback for node 69f8d1fb0573a8210e13012c INFO: 172.20.0.1:36572 - "POST /node/69f8d1fb0573a8210e13012c HTTP/1.0" 202 Accepted 2026-05-04 17:07:27,530 - lava_callback - INFO - Starting async job submit for node 69f8d1fb0573a8210e13012c 2026-05-04 17:07:27,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:27,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fb0573a8210e13012c HTTP/1.1" 200 None 2026-05-04 17:07:27,586 - lava_callback - DEBUG - Processing node 69f8d1fb0573a8210e13012c: baseline-arm64-pengutronix 2026-05-04 17:07:27,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:28,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:28,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1fb0573a8210e13012c/log.txt.gz 2026-05-04 17:07:28,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:28,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:28,310 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1fb0573a8210e13012c/lava-logs.yaml 2026-05-04 17:07:28,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:07:28,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:07:28,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69f8d1fb0573a8210e13012c/lava_callback.json.gz 2026-05-04 17:07:28,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:28,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fb0573a8210e13012c HTTP/1.1" 200 None 2026-05-04 17:07:28,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:28,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:07:28,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:28,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1fb0573a8210e13012c HTTP/1.1" 200 None 2026-05-04 17:07:28,533 - lava_callback - INFO - Completed processing callback for node 69f8d1fb0573a8210e13012c INFO: 172.20.0.1:49426 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:07:45,443 - lava_callback - INFO - Received callback for node 69f62f558234569b79a1ee7b INFO: 172.20.0.1:39702 - "POST /node/69f62f558234569b79a1ee7b HTTP/1.0" 202 Accepted 2026-05-04 17:07:45,449 - lava_callback - INFO - Starting async job submit for node 69f62f558234569b79a1ee7b 2026-05-04 17:07:45,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:45,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62f558234569b79a1ee7b HTTP/1.1" 200 None 2026-05-04 17:07:45,474 - lava_callback - DEBUG - Processing node 69f62f558234569b79a1ee7b: baseline-arm-clabbe 2026-05-04 17:07:45,474 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62f558234569b79a1ee7b 2026-05-04 17:07:45,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:45,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62f558234569b79a1ee7b HTTP/1.1" 200 None 2026-05-04 17:07:45,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:45,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 17:07:45,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:45,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62f558234569b79a1ee7b HTTP/1.1" 200 None 2026-05-04 17:07:45,523 - lava_callback - ERROR - Error processing callback for node 69f62f558234569b79a1ee7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46010 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:07:57,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:07:57,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58774 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:08:07,214 - lava_callback - INFO - Received callback for node 69f8cdb70573a8210e12fb22 INFO: 172.20.0.1:58786 - "POST /node/69f8cdb70573a8210e12fb22 HTTP/1.0" 202 Accepted 2026-05-04 17:08:07,220 - lava_callback - INFO - Starting async job submit for node 69f8cdb70573a8210e12fb22 2026-05-04 17:08:07,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:07,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb70573a8210e12fb22 HTTP/1.1" 200 None 2026-05-04 17:08:07,256 - lava_callback - DEBUG - Processing node 69f8cdb70573a8210e12fb22: baseline-arm-broonie 2026-05-04 17:08:07,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:07,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:07,578 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f8cdb70573a8210e12fb22/log.txt.gz 2026-05-04 17:08:07,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:07,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:07,828 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f8cdb70573a8210e12fb22/lava-logs.yaml 2026-05-04 17:08:07,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:07,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:07,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f8cdb70573a8210e12fb22/lava_callback.json.gz 2026-05-04 17:08:07,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:07,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb70573a8210e12fb22 HTTP/1.1" 200 None 2026-05-04 17:08:07,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:07,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 17:08:07,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdb70573a8210e12fb22 HTTP/1.1" 200 None 2026-05-04 17:08:08,017 - lava_callback - INFO - Completed processing callback for node 69f8cdb70573a8210e12fb22 2026-05-04 17:08:09,221 - lava_callback - INFO - Received callback for node 69f8cec30573a8210e12fd56 INFO: 172.20.0.1:58798 - "POST /node/69f8cec30573a8210e12fd56 HTTP/1.0" 202 Accepted 2026-05-04 17:08:09,229 - lava_callback - INFO - Starting async job submit for node 69f8cec30573a8210e12fd56 2026-05-04 17:08:09,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:09,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec30573a8210e12fd56 HTTP/1.1" 200 None 2026-05-04 17:08:09,304 - lava_callback - DEBUG - Processing node 69f8cec30573a8210e12fd56: baseline-x86 2026-05-04 17:08:10,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:10,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:10,237 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec30573a8210e12fd56/log.txt.gz 2026-05-04 17:08:10,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:10,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:10,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec30573a8210e12fd56/lava-logs.yaml 2026-05-04 17:08:10,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:10,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:10,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec30573a8210e12fd56/lava_callback.json.gz DEBUG: Setup failed for 69f8cec30573a8210e12fd56. Transitting job node result: incomplete -> fail 2026-05-04 17:08:11,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:11,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec30573a8210e12fd56 HTTP/1.1" 200 None 2026-05-04 17:08:11,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:11,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6920573a8210e12ccf3 HTTP/1.1" 200 None 2026-05-04 17:08:11,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:11,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cec30573a8210e12fd56 HTTP/1.1" 200 None 2026-05-04 17:08:11,224 - lava_callback - INFO - Completed processing callback for node 69f8cec30573a8210e12fd56 2026-05-04 17:08:12,649 - lava_callback - INFO - Received callback for node 69f8d1f30573a8210e130113 INFO: 172.20.0.1:43362 - "POST /node/69f8d1f30573a8210e130113 HTTP/1.0" 202 Accepted 2026-05-04 17:08:12,660 - lava_callback - INFO - Starting async job submit for node 69f8d1f30573a8210e130113 2026-05-04 17:08:12,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:12,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f30573a8210e130113 HTTP/1.1" 200 None 2026-05-04 17:08:12,696 - lava_callback - DEBUG - Processing node 69f8d1f30573a8210e130113: baseline-arm64-clabbe 2026-05-04 17:08:12,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:13,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:13,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f8d1f30573a8210e130113/log.txt.gz 2026-05-04 17:08:13,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:13,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:13,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f8d1f30573a8210e130113/lava-logs.yaml 2026-05-04 17:08:13,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:13,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:13,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69f8d1f30573a8210e130113/lava_callback.json.gz 2026-05-04 17:08:13,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:13,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1f30573a8210e130113 HTTP/1.1" 200 None 2026-05-04 17:08:13,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:13,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:08:13,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:13,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1f30573a8210e130113 HTTP/1.1" 200 None 2026-05-04 17:08:13,446 - lava_callback - INFO - Completed processing callback for node 69f8d1f30573a8210e130113 INFO: 172.20.0.1:43370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50228 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:08:27,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:27,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:08:34,983 - lava_callback - INFO - Received callback for node 69f8d1bb0573a8210e130025 INFO: 172.20.0.1:54510 - "POST /node/69f8d1bb0573a8210e130025 HTTP/1.0" 202 Accepted 2026-05-04 17:08:34,989 - lava_callback - INFO - Starting async job submit for node 69f8d1bb0573a8210e130025 2026-05-04 17:08:35,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:35,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bb0573a8210e130025 HTTP/1.1" 200 None 2026-05-04 17:08:35,021 - lava_callback - DEBUG - Processing node 69f8d1bb0573a8210e130025: baseline-arm64 2026-05-04 17:08:35,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:35,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:35,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bb0573a8210e130025/log.txt.gz 2026-05-04 17:08:35,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:35,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:35,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bb0573a8210e130025/lava-logs.yaml 2026-05-04 17:08:35,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:08:35,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:08:35,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1bb0573a8210e130025/lava_callback.json.gz 2026-05-04 17:08:36,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:36,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1bb0573a8210e130025 HTTP/1.1" 200 None 2026-05-04 17:08:36,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:36,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:08:36,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:36,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1bb0573a8210e130025 HTTP/1.1" 200 None 2026-05-04 17:08:36,135 - lava_callback - INFO - Completed processing callback for node 69f8d1bb0573a8210e130025 INFO: 172.20.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60652 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:08:57,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:08:57,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44106 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:09:31,220 - lava_callback - INFO - Received callback for node 69f8d1ca0573a8210e130050 INFO: 172.20.0.1:51172 - "POST /node/69f8d1ca0573a8210e130050 HTTP/1.0" 202 Accepted 2026-05-04 17:09:31,227 - lava_callback - INFO - Starting async job submit for node 69f8d1ca0573a8210e130050 2026-05-04 17:09:31,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:31,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ca0573a8210e130050 HTTP/1.1" 200 None 2026-05-04 17:09:31,259 - lava_callback - DEBUG - Processing node 69f8d1ca0573a8210e130050: baseline-nfs-arm64 2026-05-04 17:09:31,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:09:31,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:09:31,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1ca0573a8210e130050/log.txt.gz 2026-05-04 17:09:31,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:09:32,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:09:32,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1ca0573a8210e130050/lava-logs.yaml 2026-05-04 17:09:32,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:09:32,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:09:32,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1ca0573a8210e130050/lava_callback.json.gz 2026-05-04 17:09:32,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:32,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ca0573a8210e130050 HTTP/1.1" 200 None 2026-05-04 17:09:32,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:32,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:09:32,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1ca0573a8210e130050 HTTP/1.1" 200 None 2026-05-04 17:09:32,332 - lava_callback - INFO - Completed processing callback for node 69f8d1ca0573a8210e130050 INFO: 172.20.0.1:51182 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:09:45,510 - lava_callback - INFO - Received callback for node 69f62fc48234569b79a1eea8 INFO: 172.20.0.1:33072 - "POST /node/69f62fc48234569b79a1eea8 HTTP/1.0" 202 Accepted 2026-05-04 17:09:45,516 - lava_callback - INFO - Starting async job submit for node 69f62fc48234569b79a1eea8 2026-05-04 17:09:45,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:45,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62fc48234569b79a1eea8 HTTP/1.1" 200 None 2026-05-04 17:09:45,538 - lava_callback - DEBUG - Processing node 69f62fc48234569b79a1eea8: baseline-arm-clabbe 2026-05-04 17:09:45,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f62fc48234569b79a1eea8 2026-05-04 17:09:45,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:45,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f62fc48234569b79a1eea8 HTTP/1.1" 200 None 2026-05-04 17:09:45,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:45,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 17:09:45,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:45,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f62fc48234569b79a1eea8 HTTP/1.1" 200 None 2026-05-04 17:09:45,596 - lava_callback - ERROR - Error processing callback for node 69f62fc48234569b79a1eea8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48310 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:09:57,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:09:57,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48014 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:11:51,350 - lava_callback - INFO - Received callback for node 69f8d1fd0573a8210e130132 INFO: 172.20.0.1:36540 - "POST /node/69f8d1fd0573a8210e130132 HTTP/1.0" 202 Accepted 2026-05-04 17:11:51,360 - lava_callback - INFO - Starting async job submit for node 69f8d1fd0573a8210e130132 2026-05-04 17:11:51,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:11:51,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fd0573a8210e130132 HTTP/1.1" 200 None 2026-05-04 17:11:51,439 - lava_callback - DEBUG - Processing node 69f8d1fd0573a8210e130132: baseline-arm64-foundriesio 2026-05-04 17:11:53,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:11:53,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:11:53,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d1fd0573a8210e130132/log.txt.gz 2026-05-04 17:11:53,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:11:54,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:11:54,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d1fd0573a8210e130132/lava-logs.yaml 2026-05-04 17:11:54,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:11:54,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:11:54,212 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d1fd0573a8210e130132/lava_callback.json.gz DEBUG: Setup failed for 69f8d1fd0573a8210e130132. Transitting job node result: incomplete -> fail 2026-05-04 17:11:54,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:11:54,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1fd0573a8210e130132 HTTP/1.1" 200 None 2026-05-04 17:11:54,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:11:54,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:11:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:11:54,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1fd0573a8210e130132 HTTP/1.1" 200 None 2026-05-04 17:11:54,477 - lava_callback - INFO - Completed processing callback for node 69f8d1fd0573a8210e130132 INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:11:57,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:11:57,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36550 - "GET /node/6992c73998a8bdb31c3a201b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59202 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:12:39,250 - lava_callback - INFO - Received callback for node 69f8d1c80573a8210e130048 INFO: 172.20.0.1:59208 - "POST /node/69f8d1c80573a8210e130048 HTTP/1.0" 202 Accepted 2026-05-04 17:12:39,263 - lava_callback - INFO - Starting async job submit for node 69f8d1c80573a8210e130048 2026-05-04 17:12:39,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:39,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c80573a8210e130048 HTTP/1.1" 200 None 2026-05-04 17:12:39,343 - lava_callback - DEBUG - Processing node 69f8d1c80573a8210e130048: baseline-arm64 2026-05-04 17:12:39,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:12:39,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:12:40,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c80573a8210e130048/log.txt.gz 2026-05-04 17:12:40,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:12:40,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:12:40,439 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c80573a8210e130048/lava-logs.yaml 2026-05-04 17:12:40,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:12:40,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:12:40,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c80573a8210e130048/lava_callback.json.gz DEBUG: Setup failed for 69f8d1c80573a8210e130048. Transitting job node result: incomplete -> fail 2026-05-04 17:12:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:40,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c80573a8210e130048 HTTP/1.1" 200 None 2026-05-04 17:12:40,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:40,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:12:40,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:40,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c80573a8210e130048 HTTP/1.1" 200 None 2026-05-04 17:12:40,813 - lava_callback - INFO - Completed processing callback for node 69f8d1c80573a8210e130048 2026-05-04 17:12:45,874 - lava_callback - INFO - Received callback for node 69f630798234569b79a1ef00 INFO: 172.20.0.1:60788 - "POST /node/69f630798234569b79a1ef00 HTTP/1.0" 202 Accepted 2026-05-04 17:12:45,880 - lava_callback - INFO - Starting async job submit for node 69f630798234569b79a1ef00 2026-05-04 17:12:45,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:45,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f630798234569b79a1ef00 HTTP/1.1" 200 None 2026-05-04 17:12:45,897 - lava_callback - DEBUG - Processing node 69f630798234569b79a1ef00: baseline-arm-clabbe 2026-05-04 17:12:45,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f630798234569b79a1ef00 2026-05-04 17:12:45,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:45,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f630798234569b79a1ef00 HTTP/1.1" 200 None 2026-05-04 17:12:45,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:45,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 17:12:45,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:45,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f630798234569b79a1ef00 HTTP/1.1" 200 None 2026-05-04 17:12:45,971 - lava_callback - ERROR - Error processing callback for node 69f630798234569b79a1ef00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60802 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:12:55,066 - lava_callback - INFO - Received callback for node 69f8cdb90573a8210e12fb29 INFO: 172.20.0.1:54166 - "POST /node/69f8cdb90573a8210e12fb29 HTTP/1.0" 202 Accepted 2026-05-04 17:12:55,073 - lava_callback - INFO - Starting async job submit for node 69f8cdb90573a8210e12fb29 2026-05-04 17:12:55,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:55,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb90573a8210e12fb29 HTTP/1.1" 200 None 2026-05-04 17:12:55,117 - lava_callback - DEBUG - Processing node 69f8cdb90573a8210e12fb29: baseline-arm-broonie 2026-05-04 17:12:55,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:12:55,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:12:55,597 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f8cdb90573a8210e12fb29/log.txt.gz 2026-05-04 17:12:55,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:12:55,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:12:56,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f8cdb90573a8210e12fb29/lava-logs.yaml 2026-05-04 17:12:56,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:12:56,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:12:56,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69f8cdb90573a8210e12fb29/lava_callback.json.gz 2026-05-04 17:12:56,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:56,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdb90573a8210e12fb29 HTTP/1.1" 200 None 2026-05-04 17:12:56,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:56,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 17:12:56,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:56,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdb90573a8210e12fb29 HTTP/1.1" 200 None 2026-05-04 17:12:56,235 - lava_callback - INFO - Completed processing callback for node 69f8cdb90573a8210e12fb29 INFO: 172.20.0.1:54182 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:12:57,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:12:57,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46598 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:13:22,528 - lava_callback - INFO - Received callback for node 69f8d39a0573a8210e130395 INFO: 172.20.0.1:46614 - "POST /node/69f8d39a0573a8210e130395 HTTP/1.0" 202 Accepted 2026-05-04 17:13:22,538 - lava_callback - INFO - Starting async job submit for node 69f8d39a0573a8210e130395 2026-05-04 17:13:22,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:13:22,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d39a0573a8210e130395 HTTP/1.1" 200 None 2026-05-04 17:13:22,566 - lava_callback - DEBUG - Processing node 69f8d39a0573a8210e130395: baseline-arm 2026-05-04 17:13:22,572 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:13:22,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:13:22,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:13:22,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8d39a0573a8210e130395/lava-logs.yaml 2026-05-04 17:13:22,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:13:22,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:13:22,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8d39a0573a8210e130395/lava_callback.json.gz 2026-05-04 17:13:22,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:13:22,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d39a0573a8210e130395 HTTP/1.1" 200 None 2026-05-04 17:13:22,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:13:22,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 17:13:22,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:13:22,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d39a0573a8210e130395 HTTP/1.1" 200 None 2026-05-04 17:13:22,796 - lava_callback - INFO - Completed processing callback for node 69f8d39a0573a8210e130395 INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:13:27,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:13:27,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33166 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:15:48,290 - lava_callback - INFO - Received callback for node 69f8d1c30573a8210e13003c INFO: 172.20.0.1:33176 - "POST /node/69f8d1c30573a8210e13003c HTTP/1.0" 202 Accepted 2026-05-04 17:15:48,297 - lava_callback - INFO - Starting async job submit for node 69f8d1c30573a8210e13003c 2026-05-04 17:15:48,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:15:48,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c30573a8210e13003c HTTP/1.1" 200 None 2026-05-04 17:15:48,338 - lava_callback - DEBUG - Processing node 69f8d1c30573a8210e13003c: baseline-arm64 2026-05-04 17:15:48,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:15:48,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:15:48,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c30573a8210e13003c/log.txt.gz 2026-05-04 17:15:49,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:15:49,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:15:49,407 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c30573a8210e13003c/lava-logs.yaml 2026-05-04 17:15:49,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:15:49,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:15:49,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d1c30573a8210e13003c/lava_callback.json.gz 2026-05-04 17:15:49,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:15:49,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1c30573a8210e13003c HTTP/1.1" 200 None 2026-05-04 17:15:49,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:15:49,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:15:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:15:49,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1c30573a8210e13003c HTTP/1.1" 200 None 2026-05-04 17:15:49,716 - lava_callback - INFO - Completed processing callback for node 69f8d1c30573a8210e13003c INFO: 172.20.0.1:53914 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:15:57,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:15:57,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47334 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:16:16,618 - lava_callback - INFO - Received callback for node 69f8cdeb0573a8210e12fc03 INFO: 172.20.0.1:47350 - "POST /node/69f8cdeb0573a8210e12fc03 HTTP/1.0" 202 Accepted 2026-05-04 17:16:16,625 - lava_callback - INFO - Starting async job submit for node 69f8cdeb0573a8210e12fc03 2026-05-04 17:16:16,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:16,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdeb0573a8210e12fc03 HTTP/1.1" 200 None 2026-05-04 17:16:16,666 - lava_callback - DEBUG - Processing node 69f8cdeb0573a8210e12fc03: ltp-syscalls 2026-05-04 17:16:17,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:16:17,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:16:17,540 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f8cdeb0573a8210e12fc03/log.txt.gz 2026-05-04 17:16:17,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:16:18,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:16:18,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f8cdeb0573a8210e12fc03/lava-logs.yaml 2026-05-04 17:16:18,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:16:18,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:16:18,517 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69f8cdeb0573a8210e12fc03/lava_callback.json.gz 2026-05-04 17:16:18,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:18,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cdeb0573a8210e12fc03 HTTP/1.1" 200 None 2026-05-04 17:16:18,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:18,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 17:16:18,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:18,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cdeb0573a8210e12fc03 HTTP/1.1" 200 None 2026-05-04 17:16:18,593 - lava_callback - INFO - Completed processing callback for node 69f8cdeb0573a8210e12fc03 2026-05-04 17:16:19,723 - lava_callback - INFO - Received callback for node 69f8d1d20573a8210e130098 INFO: 172.20.0.1:37342 - "POST /node/69f8d1d20573a8210e130098 HTTP/1.0" 202 Accepted 2026-05-04 17:16:19,730 - lava_callback - INFO - Starting async job submit for node 69f8d1d20573a8210e130098 2026-05-04 17:16:19,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:19,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d20573a8210e130098 HTTP/1.1" 200 None 2026-05-04 17:16:19,769 - lava_callback - DEBUG - Processing node 69f8d1d20573a8210e130098: baseline-nfs-arm64 2026-05-04 17:16:20,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:16:20,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:16:20,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d20573a8210e130098/log.txt.gz 2026-05-04 17:16:20,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:16:20,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:16:20,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d20573a8210e130098/lava-logs.yaml 2026-05-04 17:16:20,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:16:21,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:16:21,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1d20573a8210e130098/lava_callback.json.gz 2026-05-04 17:16:21,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:21,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1d20573a8210e130098 HTTP/1.1" 200 None 2026-05-04 17:16:21,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:21,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:16:21,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:21,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1d20573a8210e130098 HTTP/1.1" 200 None 2026-05-04 17:16:21,136 - lava_callback - INFO - Completed processing callback for node 69f8d1d20573a8210e130098 INFO: 172.20.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37364 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:16:27,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:16:27,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:19:55,024 - lava_callback - INFO - Received callback for node 69f8cec50573a8210e12fd5e INFO: 172.20.0.1:46366 - "POST /node/69f8cec50573a8210e12fd5e HTTP/1.0" 202 Accepted 2026-05-04 17:19:55,029 - lava_callback - INFO - Starting async job submit for node 69f8cec50573a8210e12fd5e 2026-05-04 17:19:55,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:19:55,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec50573a8210e12fd5e HTTP/1.1" 200 None 2026-05-04 17:19:55,061 - lava_callback - DEBUG - Processing node 69f8cec50573a8210e12fd5e: baseline-x86 2026-05-04 17:19:55,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:19:55,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:19:55,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec50573a8210e12fd5e/log.txt.gz 2026-05-04 17:19:55,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:19:56,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:19:56,041 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec50573a8210e12fd5e/lava-logs.yaml 2026-05-04 17:19:56,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:19:56,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:19:56,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f8cec50573a8210e12fd5e/lava_callback.json.gz 2026-05-04 17:19:56,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:19:56,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8cec50573a8210e12fd5e HTTP/1.1" 200 None 2026-05-04 17:19:56,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:19:56,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6920573a8210e12ccf3 HTTP/1.1" 200 None 2026-05-04 17:19:56,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:19:56,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8cec50573a8210e12fd5e HTTP/1.1" 200 None 2026-05-04 17:19:56,257 - lava_callback - INFO - Completed processing callback for node 69f8cec50573a8210e12fd5e INFO: 172.20.0.1:46370 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:19:57,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:19:57,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35400 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:24:41,661 - lava_callback - INFO - Received callback for node 69f633548234569b79a1f074 INFO: 172.20.0.1:48596 - "POST /node/69f633548234569b79a1f074 HTTP/1.0" 202 Accepted 2026-05-04 17:24:41,666 - lava_callback - INFO - Starting async job submit for node 69f633548234569b79a1f074 2026-05-04 17:24:41,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:41,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f633548234569b79a1f074 HTTP/1.1" 200 None 2026-05-04 17:24:41,681 - lava_callback - DEBUG - Processing node 69f633548234569b79a1f074: baseline-arm64-baylibre 2026-05-04 17:24:41,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f633548234569b79a1f074 2026-05-04 17:24:41,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:41,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f633548234569b79a1f074 HTTP/1.1" 200 None 2026-05-04 17:24:41,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:41,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 17:24:41,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:41,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f633548234569b79a1f074 HTTP/1.1" 200 None 2026-05-04 17:24:41,731 - lava_callback - ERROR - Error processing callback for node 69f633548234569b79a1f074: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 17:24:45,872 - lava_callback - INFO - Received callback for node 69f8d64a0573a8210e130663 INFO: 172.20.0.1:48606 - "POST /node/69f8d64a0573a8210e130663 HTTP/1.0" 202 Accepted 2026-05-04 17:24:45,878 - lava_callback - INFO - Starting async job submit for node 69f8d64a0573a8210e130663 2026-05-04 17:24:45,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:45,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d64a0573a8210e130663 HTTP/1.1" 200 None 2026-05-04 17:24:45,895 - lava_callback - DEBUG - Processing node 69f8d64a0573a8210e130663: baseline-arm64 2026-05-04 17:24:45,900 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:24:45,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:24:46,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:24:46,029 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d64a0573a8210e130663/lava-logs.yaml 2026-05-04 17:24:46,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:24:46,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:24:46,280 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d64a0573a8210e130663/lava_callback.json.gz 2026-05-04 17:24:46,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:46,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d64a0573a8210e130663 HTTP/1.1" 200 None 2026-05-04 17:24:46,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:46,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:24:46,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:46,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d64a0573a8210e130663 HTTP/1.1" 200 None 2026-05-04 17:24:46,354 - lava_callback - INFO - Completed processing callback for node 69f8d64a0573a8210e130663 INFO: 172.20.0.1:48610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40936 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:24:57,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:24:57,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:25:03,334 - lava_callback - INFO - Received callback for node 69f8d64e0573a8210e130666 INFO: 172.20.0.1:49106 - "POST /node/69f8d64e0573a8210e130666 HTTP/1.0" 202 Accepted 2026-05-04 17:25:03,340 - lava_callback - INFO - Starting async job submit for node 69f8d64e0573a8210e130666 2026-05-04 17:25:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:03,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d64e0573a8210e130666 HTTP/1.1" 200 None 2026-05-04 17:25:03,375 - lava_callback - DEBUG - Processing node 69f8d64e0573a8210e130666: baseline-arm64 2026-05-04 17:25:03,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:25:03,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:25:03,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d64e0573a8210e130666/log.txt.gz 2026-05-04 17:25:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:25:03,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:25:03,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d64e0573a8210e130666/lava-logs.yaml 2026-05-04 17:25:03,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:25:04,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:25:04,150 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d64e0573a8210e130666/lava_callback.json.gz 2026-05-04 17:25:04,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:04,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d64e0573a8210e130666 HTTP/1.1" 200 None 2026-05-04 17:25:04,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:04,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:25:04,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:04,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d64e0573a8210e130666 HTTP/1.1" 200 None 2026-05-04 17:25:04,223 - lava_callback - INFO - Completed processing callback for node 69f8d64e0573a8210e130666 INFO: 172.20.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55370 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:25:20,444 - lava_callback - INFO - Received callback for node 69f8d1cc0573a8210e130056 INFO: 172.20.0.1:55686 - "POST /node/69f8d1cc0573a8210e130056 HTTP/1.0" 202 Accepted 2026-05-04 17:25:20,453 - lava_callback - INFO - Starting async job submit for node 69f8d1cc0573a8210e130056 2026-05-04 17:25:20,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:20,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1cc0573a8210e130056 HTTP/1.1" 200 None 2026-05-04 17:25:20,542 - lava_callback - DEBUG - Processing node 69f8d1cc0573a8210e130056: baseline-nfs-arm64 INFO: 172.20.0.1:55692 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:25:21,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:25:21,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:25:21,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cc0573a8210e130056/log.txt.gz 2026-05-04 17:25:22,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:25:22,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:25:22,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cc0573a8210e130056/lava-logs.yaml 2026-05-04 17:25:22,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:25:22,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:25:22,897 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d1cc0573a8210e130056/lava_callback.json.gz DEBUG: Setup failed for 69f8d1cc0573a8210e130056. Transitting job node result: incomplete -> fail 2026-05-04 17:25:22,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:23,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1cc0573a8210e130056 HTTP/1.1" 200 None 2026-05-04 17:25:23,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:23,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:25:23,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:23,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1cc0573a8210e130056 HTTP/1.1" 200 None 2026-05-04 17:25:23,124 - lava_callback - INFO - Completed processing callback for node 69f8d1cc0573a8210e130056 INFO: 172.20.0.1:55704 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:25:27,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:25:27,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53696 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:26:06,128 - lava_callback - INFO - Received callback for node 69f633a18234569b79a1f095 INFO: 172.20.0.1:57390 - "POST /node/69f633a18234569b79a1f095 HTTP/1.0" 202 Accepted 2026-05-04 17:26:06,135 - lava_callback - INFO - Starting async job submit for node 69f633a18234569b79a1f095 2026-05-04 17:26:06,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:26:06,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f633a18234569b79a1f095 HTTP/1.1" 200 None 2026-05-04 17:26:06,187 - lava_callback - DEBUG - Processing node 69f633a18234569b79a1f095: baseline-arm64-clabbe 2026-05-04 17:26:06,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f633a18234569b79a1f095 2026-05-04 17:26:06,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:26:06,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f633a18234569b79a1f095 HTTP/1.1" 200 None 2026-05-04 17:26:06,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:26:06,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 17:26:06,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:26:06,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f633a18234569b79a1f095 HTTP/1.1" 200 None 2026-05-04 17:26:06,259 - lava_callback - ERROR - Error processing callback for node 69f633a18234569b79a1f095: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:27:26,225 - lava_callback - INFO - Received callback for node 69f633eb8234569b79a1f0cd INFO: 172.20.0.1:38444 - "POST /node/69f633eb8234569b79a1f0cd HTTP/1.0" 202 Accepted 2026-05-04 17:27:26,230 - lava_callback - INFO - Starting async job submit for node 69f633eb8234569b79a1f0cd 2026-05-04 17:27:26,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:26,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f633eb8234569b79a1f0cd HTTP/1.1" 200 None 2026-05-04 17:27:26,246 - lava_callback - DEBUG - Processing node 69f633eb8234569b79a1f0cd: baseline-arm64-clabbe 2026-05-04 17:27:26,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f633eb8234569b79a1f0cd 2026-05-04 17:27:26,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:26,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f633eb8234569b79a1f0cd HTTP/1.1" 200 None 2026-05-04 17:27:26,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:26,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 17:27:26,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:26,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f633eb8234569b79a1f0cd HTTP/1.1" 200 None 2026-05-04 17:27:26,302 - lava_callback - ERROR - Error processing callback for node 69f633eb8234569b79a1f0cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50428 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:27:46,235 - lava_callback - INFO - Received callback for node 69f8d7000573a8210e130703 INFO: 172.20.0.1:35328 - "POST /node/69f8d7000573a8210e130703 HTTP/1.0" 202 Accepted 2026-05-04 17:27:46,241 - lava_callback - INFO - Starting async job submit for node 69f8d7000573a8210e130703 2026-05-04 17:27:46,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:46,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d7000573a8210e130703 HTTP/1.1" 200 None 2026-05-04 17:27:46,257 - lava_callback - DEBUG - Processing node 69f8d7000573a8210e130703: baseline-nfs-arm64 2026-05-04 17:27:46,258 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:27:46,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:27:46,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:27:46,375 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d7000573a8210e130703/lava-logs.yaml 2026-05-04 17:27:46,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:27:46,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:27:46,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8d7000573a8210e130703/lava_callback.json.gz 2026-05-04 17:27:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:46,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d7000573a8210e130703 HTTP/1.1" 200 None 2026-05-04 17:27:46,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:35344 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:27:46,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:27:46,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:46,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d7000573a8210e130703 HTTP/1.1" 200 None 2026-05-04 17:27:46,552 - lava_callback - INFO - Completed processing callback for node 69f8d7000573a8210e130703 INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:27:57,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:27:57,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33876 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:28:26,236 - lava_callback - INFO - Received callback for node 69f634358234569b79a1f0e9 INFO: 172.20.0.1:33880 - "POST /node/69f634358234569b79a1f0e9 HTTP/1.0" 202 Accepted 2026-05-04 17:28:26,242 - lava_callback - INFO - Starting async job submit for node 69f634358234569b79a1f0e9 2026-05-04 17:28:26,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:28:26,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f634358234569b79a1f0e9 HTTP/1.1" 200 None 2026-05-04 17:28:26,258 - lava_callback - DEBUG - Processing node 69f634358234569b79a1f0e9: baseline-arm64-clabbe 2026-05-04 17:28:26,258 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f634358234569b79a1f0e9 2026-05-04 17:28:26,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:28:26,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f634358234569b79a1f0e9 HTTP/1.1" 200 None 2026-05-04 17:28:26,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:28:26,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 17:28:26,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:28:26,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f634358234569b79a1f0e9 HTTP/1.1" 200 None 2026-05-04 17:28:26,310 - lava_callback - ERROR - Error processing callback for node 69f634358234569b79a1f0e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57354 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:29:46,342 - lava_callback - INFO - Received callback for node 69f6347f8234569b79a1f115 INFO: 172.20.0.1:47676 - "POST /node/69f6347f8234569b79a1f115 HTTP/1.0" 202 Accepted 2026-05-04 17:29:46,348 - lava_callback - INFO - Starting async job submit for node 69f6347f8234569b79a1f115 2026-05-04 17:29:46,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:29:46,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6347f8234569b79a1f115 HTTP/1.1" 200 None 2026-05-04 17:29:46,362 - lava_callback - DEBUG - Processing node 69f6347f8234569b79a1f115: baseline-arm64-clabbe 2026-05-04 17:29:46,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6347f8234569b79a1f115 2026-05-04 17:29:46,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:29:46,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6347f8234569b79a1f115 HTTP/1.1" 200 None 2026-05-04 17:29:46,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:29:46,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 17:29:46,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:29:46,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6347f8234569b79a1f115 HTTP/1.1" 200 None 2026-05-04 17:29:46,423 - lava_callback - ERROR - Error processing callback for node 69f6347f8234569b79a1f115: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51514 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:30:36,483 - lava_callback - INFO - Received callback for node 69f8d77b0573a8210e13076a INFO: 172.20.0.1:56664 - "POST /node/69f8d77b0573a8210e13076a HTTP/1.0" 202 Accepted 2026-05-04 17:30:36,490 - lava_callback - INFO - Starting async job submit for node 69f8d77b0573a8210e13076a INFO: 172.20.0.1:56674 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:30:36,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:30:36,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d77b0573a8210e13076a HTTP/1.1" 200 None 2026-05-04 17:30:36,556 - lava_callback - DEBUG - Processing node 69f8d77b0573a8210e13076a: baseline-arm64 2026-05-04 17:30:36,689 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:30:36,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:30:36,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:30:36,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d77b0573a8210e13076a/lava-logs.yaml 2026-05-04 17:30:36,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:30:37,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:30:37,012 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d77b0573a8210e13076a/lava_callback.json.gz 2026-05-04 17:30:37,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:30:37,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d77b0573a8210e13076a HTTP/1.1" 200 None 2026-05-04 17:30:37,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:30:37,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:30:37,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:30:37,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d77b0573a8210e13076a HTTP/1.1" 200 None 2026-05-04 17:30:37,192 - lava_callback - INFO - Completed processing callback for node 69f8d77b0573a8210e13076a INFO: 172.20.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43058 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:30:57,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:30:57,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38312 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:31:36,465 - lava_callback - INFO - Received callback for node 69f8d7cf0573a8210e1307b7 INFO: 172.20.0.1:52138 - "POST /node/69f8d7cf0573a8210e1307b7 HTTP/1.0" 202 Accepted 2026-05-04 17:31:36,472 - lava_callback - INFO - Starting async job submit for node 69f8d7cf0573a8210e1307b7 2026-05-04 17:31:36,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:52146 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:31:36,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d7cf0573a8210e1307b7 HTTP/1.1" 200 None 2026-05-04 17:31:36,516 - lava_callback - DEBUG - Processing node 69f8d7cf0573a8210e1307b7: baseline-arm64 2026-05-04 17:31:36,656 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:31:36,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:31:37,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:31:37,117 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d7cf0573a8210e1307b7/lava-logs.yaml 2026-05-04 17:31:37,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:31:37,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:31:37,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d7cf0573a8210e1307b7/lava_callback.json.gz 2026-05-04 17:31:37,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:31:37,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d7cf0573a8210e1307b7 HTTP/1.1" 200 None 2026-05-04 17:31:37,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:31:37,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:31:37,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:31:37,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d7cf0573a8210e1307b7 HTTP/1.1" 200 None 2026-05-04 17:31:37,375 - lava_callback - INFO - Completed processing callback for node 69f8d7cf0573a8210e1307b7 INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34800 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:31:57,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:31:57,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:32:06,424 - lava_callback - INFO - Received callback for node 69f635138234569b79a1f16f INFO: 172.20.0.1:41106 - "POST /node/69f635138234569b79a1f16f HTTP/1.0" 202 Accepted 2026-05-04 17:32:06,430 - lava_callback - INFO - Starting async job submit for node 69f635138234569b79a1f16f 2026-05-04 17:32:06,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:32:06,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f635138234569b79a1f16f HTTP/1.1" 200 None 2026-05-04 17:32:06,445 - lava_callback - DEBUG - Processing node 69f635138234569b79a1f16f: baseline-arm64-clabbe 2026-05-04 17:32:06,445 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f635138234569b79a1f16f 2026-05-04 17:32:06,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:32:06,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f635138234569b79a1f16f HTTP/1.1" 200 None 2026-05-04 17:32:06,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:32:06,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 17:32:06,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:32:06,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f635138234569b79a1f16f HTTP/1.1" 200 None 2026-05-04 17:32:06,503 - lava_callback - ERROR - Error processing callback for node 69f635138234569b79a1f16f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:33:26,405 - lava_callback - INFO - Received callback for node 69f6355c8234569b79a1f18a INFO: 172.20.0.1:33738 - "POST /node/69f6355c8234569b79a1f18a HTTP/1.0" 202 Accepted 2026-05-04 17:33:26,410 - lava_callback - INFO - Starting async job submit for node 69f6355c8234569b79a1f18a 2026-05-04 17:33:26,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:33:26,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6355c8234569b79a1f18a HTTP/1.1" 200 None 2026-05-04 17:33:26,425 - lava_callback - DEBUG - Processing node 69f6355c8234569b79a1f18a: baseline-arm64-clabbe 2026-05-04 17:33:26,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6355c8234569b79a1f18a 2026-05-04 17:33:26,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:33:26,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6355c8234569b79a1f18a HTTP/1.1" 200 None 2026-05-04 17:33:26,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:33:26,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 17:33:26,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:33:26,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6355c8234569b79a1f18a HTTP/1.1" 200 None 2026-05-04 17:33:26,472 - lava_callback - ERROR - Error processing callback for node 69f6355c8234569b79a1f18a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34814 - "GET /node/69866317177ca0f097bd4822%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:44846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49414 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:38:34,316 - lava_callback - INFO - Received callback for node 69f8d8c00573a8210e130862 INFO: 172.20.0.1:56862 - "POST /node/69f8d8c00573a8210e130862 HTTP/1.0" 202 Accepted 2026-05-04 17:38:34,322 - lava_callback - INFO - Starting async job submit for node 69f8d8c00573a8210e130862 2026-05-04 17:38:34,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:38:34,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d8c00573a8210e130862 HTTP/1.1" 200 None 2026-05-04 17:38:34,372 - lava_callback - DEBUG - Processing node 69f8d8c00573a8210e130862: baseline-arm64 2026-05-04 17:38:34,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:38:34,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:38:34,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d8c00573a8210e130862/log.txt.gz 2026-05-04 17:38:35,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:38:35,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:38:35,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d8c00573a8210e130862/lava-logs.yaml 2026-05-04 17:38:35,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:38:35,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:38:35,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d8c00573a8210e130862/lava_callback.json.gz 2026-05-04 17:38:35,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:38:35,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d8c00573a8210e130862 HTTP/1.1" 200 None 2026-05-04 17:38:35,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:38:35,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:38:35,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:38:35,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d8c00573a8210e130862 HTTP/1.1" 200 None 2026-05-04 17:38:35,498 - lava_callback - INFO - Completed processing callback for node 69f8d8c00573a8210e130862 INFO: 172.20.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52546 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:38:57,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:38:57,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59280 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:40:44,304 - lava_callback - INFO - Received callback for node 69f8da120573a8210e13095f INFO: 172.20.0.1:47196 - "POST /node/69f8da120573a8210e13095f HTTP/1.0" 202 Accepted 2026-05-04 17:40:44,310 - lava_callback - INFO - Starting async job submit for node 69f8da120573a8210e13095f 2026-05-04 17:40:44,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:40:44,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8da120573a8210e13095f HTTP/1.1" 200 None 2026-05-04 17:40:44,327 - lava_callback - DEBUG - Processing node 69f8da120573a8210e13095f: baseline-arm 2026-05-04 17:40:44,332 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:40:44,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:40:44,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:40:44,479 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8da120573a8210e13095f/lava-logs.yaml 2026-05-04 17:40:44,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:40:44,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:40:44,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8da120573a8210e13095f/lava_callback.json.gz 2026-05-04 17:40:44,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:40:44,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8da120573a8210e13095f HTTP/1.1" 200 None 2026-05-04 17:40:44,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:40:44,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 17:40:44,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:40:44,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8da120573a8210e13095f HTTP/1.1" 200 None 2026-05-04 17:40:44,828 - lava_callback - INFO - Completed processing callback for node 69f8da120573a8210e13095f INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48912 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:40:57,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:40:57,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43958 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:43:10,125 - lava_callback - INFO - Received callback for node 69f8d9580573a8210e1308d0 INFO: 172.20.0.1:43262 - "POST /node/69f8d9580573a8210e1308d0 HTTP/1.0" 202 Accepted 2026-05-04 17:43:10,134 - lava_callback - INFO - Starting async job submit for node 69f8d9580573a8210e1308d0 2026-05-04 17:43:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:10,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d9580573a8210e1308d0 HTTP/1.1" 200 None 2026-05-04 17:43:10,203 - lava_callback - DEBUG - Processing node 69f8d9580573a8210e1308d0: baseline-arm64-foundriesio 2026-05-04 17:43:11,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:11,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:11,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d9580573a8210e1308d0/log.txt.gz 2026-05-04 17:43:12,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:12,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:12,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d9580573a8210e1308d0/lava-logs.yaml 2026-05-04 17:43:12,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:12,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:12,705 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8d9580573a8210e1308d0/lava_callback.json.gz DEBUG: Setup failed for 69f8d9580573a8210e1308d0. Transitting job node result: incomplete -> fail 2026-05-04 17:43:12,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:12,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d9580573a8210e1308d0 HTTP/1.1" 200 None 2026-05-04 17:43:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:12,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:43:12,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:12,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d9580573a8210e1308d0 HTTP/1.1" 200 None 2026-05-04 17:43:12,974 - lava_callback - INFO - Completed processing callback for node 69f8d9580573a8210e1308d0 INFO: 172.20.0.1:43268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34670 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:43:27,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:27,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:43:32,563 - lava_callback - INFO - Received callback for node 69f8d3990573a8210e13038d INFO: 172.20.0.1:55914 - "POST /node/69f8d3990573a8210e13038d HTTP/1.0" 202 Accepted 2026-05-04 17:43:32,569 - lava_callback - INFO - Starting async job submit for node 69f8d3990573a8210e13038d 2026-05-04 17:43:32,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:32,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3990573a8210e13038d HTTP/1.1" 200 None 2026-05-04 17:43:32,639 - lava_callback - DEBUG - Processing node 69f8d3990573a8210e13038d: ltp-smoke 2026-05-04 17:43:33,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:33,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:33,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8d3990573a8210e13038d/log.txt.gz 2026-05-04 17:43:33,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:33,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:33,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8d3990573a8210e13038d/lava-logs.yaml 2026-05-04 17:43:33,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:33,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:33,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8d3990573a8210e13038d/lava_callback.json.gz 2026-05-04 17:43:34,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:34,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d3990573a8210e13038d HTTP/1.1" 200 None 2026-05-04 17:43:34,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:34,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c66b0573a8210e12ccc7 HTTP/1.1" 200 None 2026-05-04 17:43:34,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:34,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d3990573a8210e13038d HTTP/1.1" 200 None 2026-05-04 17:43:34,165 - lava_callback - INFO - Completed processing callback for node 69f8d3990573a8210e13038d INFO: 172.20.0.1:55924 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:43:42,708 - lava_callback - INFO - Received callback for node 69f637b98234569b79a1f2d1 INFO: 172.20.0.1:50298 - "POST /node/69f637b98234569b79a1f2d1 HTTP/1.0" 202 Accepted 2026-05-04 17:43:42,716 - lava_callback - INFO - Starting async job submit for node 69f637b98234569b79a1f2d1 2026-05-04 17:43:42,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:42,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f637b98234569b79a1f2d1 HTTP/1.1" 200 None 2026-05-04 17:43:42,733 - lava_callback - DEBUG - Processing node 69f637b98234569b79a1f2d1: baseline-arm64-baylibre 2026-05-04 17:43:42,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f637b98234569b79a1f2d1 2026-05-04 17:43:42,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:42,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f637b98234569b79a1f2d1 HTTP/1.1" 200 None 2026-05-04 17:43:42,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:42,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:43:42,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:42,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f637b98234569b79a1f2d1 HTTP/1.1" 200 None 2026-05-04 17:43:42,778 - lava_callback - ERROR - Error processing callback for node 69f637b98234569b79a1f2d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50310 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:43:50,061 - lava_callback - INFO - Received callback for node 69f8d1e70573a8210e1300cc INFO: 172.20.0.1:47492 - "POST /node/69f8d1e70573a8210e1300cc HTTP/1.0" 202 Accepted 2026-05-04 17:43:50,067 - lava_callback - INFO - Starting async job submit for node 69f8d1e70573a8210e1300cc 2026-05-04 17:43:50,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:50,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e70573a8210e1300cc HTTP/1.1" 200 None 2026-05-04 17:43:50,103 - lava_callback - DEBUG - Processing node 69f8d1e70573a8210e1300cc: baseline-arm64-broonie 2026-05-04 17:43:50,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:50,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:50,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e70573a8210e1300cc/log.txt.gz 2026-05-04 17:43:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:50,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:50,794 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e70573a8210e1300cc/lava-logs.yaml 2026-05-04 17:43:50,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:50,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:50,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e70573a8210e1300cc/lava_callback.json.gz 2026-05-04 17:43:50,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:50,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e70573a8210e1300cc HTTP/1.1" 200 None 2026-05-04 17:43:50,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:50,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:43:50,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:51,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1e70573a8210e1300cc HTTP/1.1" 200 None 2026-05-04 17:43:51,020 - lava_callback - INFO - Completed processing callback for node 69f8d1e70573a8210e1300cc INFO: 172.20.0.1:47500 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:43:56,622 - lava_callback - INFO - Received callback for node 69f8d1ed0573a8210e1300da INFO: 172.20.0.1:47508 - "POST /node/69f8d1ed0573a8210e1300da HTTP/1.0" 202 Accepted 2026-05-04 17:43:56,628 - lava_callback - INFO - Starting async job submit for node 69f8d1ed0573a8210e1300da 2026-05-04 17:43:56,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:56,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ed0573a8210e1300da HTTP/1.1" 200 None 2026-05-04 17:43:56,668 - lava_callback - DEBUG - Processing node 69f8d1ed0573a8210e1300da: baseline-arm64-broonie 2026-05-04 17:43:56,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:57,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:57,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1ed0573a8210e1300da/log.txt.gz 2026-05-04 17:43:57,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:57,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:57,697 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1ed0573a8210e1300da/lava-logs.yaml 2026-05-04 17:43:57,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:43:57,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:57,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:43:57,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:43:57,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1ed0573a8210e1300da/lava_callback.json.gz 2026-05-04 17:43:57,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:57,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ed0573a8210e1300da HTTP/1.1" 200 None 2026-05-04 17:43:57,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:57,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:43:57,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:43:57,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1ed0573a8210e1300da HTTP/1.1" 200 None 2026-05-04 17:43:57,922 - lava_callback - INFO - Completed processing callback for node 69f8d1ed0573a8210e1300da INFO: 172.20.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:44:27,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:44:27,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:45:29,539 - lava_callback - INFO - Received callback for node 69f8d74d0573a8210e13073b INFO: 172.20.0.1:40884 - "POST /node/69f8d74d0573a8210e13073b HTTP/1.0" 202 Accepted 2026-05-04 17:45:29,549 - lava_callback - INFO - Starting async job submit for node 69f8d74d0573a8210e13073b 2026-05-04 17:45:29,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:29,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d74d0573a8210e13073b HTTP/1.1" 200 None 2026-05-04 17:45:29,622 - lava_callback - DEBUG - Processing node 69f8d74d0573a8210e13073b: baseline-arm 2026-05-04 17:45:30,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:45:30,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:45:30,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8d74d0573a8210e13073b/log.txt.gz 2026-05-04 17:45:30,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:45:31,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:45:31,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8d74d0573a8210e13073b/lava-logs.yaml 2026-05-04 17:45:31,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:45:31,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:45:31,251 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8d74d0573a8210e13073b/lava_callback.json.gz DEBUG: Setup failed for 69f8d74d0573a8210e13073b. Transitting job node result: incomplete -> fail 2026-05-04 17:45:31,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:31,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d74d0573a8210e13073b HTTP/1.1" 200 None 2026-05-04 17:45:31,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:31,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 17:45:31,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:31,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d74d0573a8210e13073b HTTP/1.1" 200 None 2026-05-04 17:45:31,506 - lava_callback - INFO - Completed processing callback for node 69f8d74d0573a8210e13073b INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36056 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:45:48,145 - lava_callback - INFO - Received callback for node 69f8d9980573a8210e1308fc INFO: 172.20.0.1:36062 - "POST /node/69f8d9980573a8210e1308fc HTTP/1.0" 202 Accepted 2026-05-04 17:45:48,155 - lava_callback - INFO - Starting async job submit for node 69f8d9980573a8210e1308fc 2026-05-04 17:45:48,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:48,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d9980573a8210e1308fc HTTP/1.1" 200 None 2026-05-04 17:45:48,218 - lava_callback - DEBUG - Processing node 69f8d9980573a8210e1308fc: baseline-arm64 2026-05-04 17:45:48,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:45:48,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:45:48,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d9980573a8210e1308fc/log.txt.gz 2026-05-04 17:45:49,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:45:49,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:45:49,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d9980573a8210e1308fc/lava-logs.yaml 2026-05-04 17:45:49,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:45:49,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:45:49,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8d9980573a8210e1308fc/lava_callback.json.gz DEBUG: Setup failed for 69f8d9980573a8210e1308fc. Transitting job node result: incomplete -> fail 2026-05-04 17:45:49,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:49,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d9980573a8210e1308fc HTTP/1.1" 200 None 2026-05-04 17:45:49,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:49,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:45:49,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:49,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d9980573a8210e1308fc HTTP/1.1" 200 None 2026-05-04 17:45:49,680 - lava_callback - INFO - Completed processing callback for node 69f8d9980573a8210e1308fc INFO: 172.20.0.1:40408 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:45:57,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:45:57,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:46:02,831 - lava_callback - INFO - Received callback for node 69f6384a8234569b79a1f32c INFO: 172.20.0.1:56598 - "POST /node/69f6384a8234569b79a1f32c HTTP/1.0" 202 Accepted 2026-05-04 17:46:02,837 - lava_callback - INFO - Starting async job submit for node 69f6384a8234569b79a1f32c 2026-05-04 17:46:02,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:46:02,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6384a8234569b79a1f32c HTTP/1.1" 200 None 2026-05-04 17:46:02,854 - lava_callback - DEBUG - Processing node 69f6384a8234569b79a1f32c: baseline-arm64-baylibre 2026-05-04 17:46:02,854 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6384a8234569b79a1f32c 2026-05-04 17:46:02,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:46:02,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6384a8234569b79a1f32c HTTP/1.1" 200 None 2026-05-04 17:46:02,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:46:02,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:46:02,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:46:02,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6384a8234569b79a1f32c HTTP/1.1" 200 None 2026-05-04 17:46:02,897 - lava_callback - ERROR - Error processing callback for node 69f6384a8234569b79a1f32c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41016 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:47:02,788 - lava_callback - INFO - Received callback for node 69f638928234569b79a1f34e INFO: 172.20.0.1:42816 - "POST /node/69f638928234569b79a1f34e HTTP/1.0" 202 Accepted 2026-05-04 17:47:02,794 - lava_callback - INFO - Starting async job submit for node 69f638928234569b79a1f34e 2026-05-04 17:47:02,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:47:02,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f638928234569b79a1f34e HTTP/1.1" 200 None 2026-05-04 17:47:02,810 - lava_callback - DEBUG - Processing node 69f638928234569b79a1f34e: baseline-arm64-baylibre 2026-05-04 17:47:02,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f638928234569b79a1f34e 2026-05-04 17:47:02,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:47:02,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f638928234569b79a1f34e HTTP/1.1" 200 None 2026-05-04 17:47:02,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:47:02,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:47:02,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:47:02,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f638928234569b79a1f34e HTTP/1.1" 200 None 2026-05-04 17:47:02,867 - lava_callback - ERROR - Error processing callback for node 69f638928234569b79a1f34e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:48:22,946 - lava_callback - INFO - Received callback for node 69f638db8234569b79a1f37d INFO: 172.20.0.1:41128 - "POST /node/69f638db8234569b79a1f37d HTTP/1.0" 202 Accepted 2026-05-04 17:48:22,951 - lava_callback - INFO - Starting async job submit for node 69f638db8234569b79a1f37d 2026-05-04 17:48:22,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:48:22,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f638db8234569b79a1f37d HTTP/1.1" 200 None 2026-05-04 17:48:22,969 - lava_callback - DEBUG - Processing node 69f638db8234569b79a1f37d: baseline-arm64-baylibre 2026-05-04 17:48:22,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f638db8234569b79a1f37d 2026-05-04 17:48:22,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:48:22,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f638db8234569b79a1f37d HTTP/1.1" 200 None 2026-05-04 17:48:22,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:48:23,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:48:23,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:48:23,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f638db8234569b79a1f37d HTTP/1.1" 200 None 2026-05-04 17:48:23,020 - lava_callback - ERROR - Error processing callback for node 69f638db8234569b79a1f37d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58936 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:49:42,992 - lava_callback - INFO - Received callback for node 69f639238234569b79a1f39d INFO: 172.20.0.1:60790 - "POST /node/69f639238234569b79a1f39d HTTP/1.0" 202 Accepted 2026-05-04 17:49:42,998 - lava_callback - INFO - Starting async job submit for node 69f639238234569b79a1f39d 2026-05-04 17:49:42,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:49:43,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f639238234569b79a1f39d HTTP/1.1" 200 None 2026-05-04 17:49:43,014 - lava_callback - DEBUG - Processing node 69f639238234569b79a1f39d: baseline-arm64-baylibre 2026-05-04 17:49:43,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f639238234569b79a1f39d 2026-05-04 17:49:43,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:49:43,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f639238234569b79a1f39d HTTP/1.1" 200 None 2026-05-04 17:49:43,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:49:43,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:49:43,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:49:43,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f639238234569b79a1f39d HTTP/1.1" 200 None 2026-05-04 17:49:43,067 - lava_callback - ERROR - Error processing callback for node 69f639238234569b79a1f39d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48044 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:50:38,483 - lava_callback - INFO - Received callback for node 69f8d8bb0573a8210e130859 INFO: 172.20.0.1:48050 - "POST /node/69f8d8bb0573a8210e130859 HTTP/1.0" 202 Accepted 2026-05-04 17:50:38,495 - lava_callback - INFO - Starting async job submit for node 69f8d8bb0573a8210e130859 2026-05-04 17:50:38,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:38,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d8bb0573a8210e130859 HTTP/1.1" 200 None 2026-05-04 17:50:38,592 - lava_callback - DEBUG - Processing node 69f8d8bb0573a8210e130859: baseline-x86 2026-05-04 17:50:39,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:50:39,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:50:39,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f8d8bb0573a8210e130859/log.txt.gz 2026-05-04 17:50:40,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:50:40,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:50:40,679 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f8d8bb0573a8210e130859/lava-logs.yaml 2026-05-04 17:50:40,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:50:40,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:50:40,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f8d8bb0573a8210e130859/lava_callback.json.gz DEBUG: Setup failed for 69f8d8bb0573a8210e130859. Transitting job node result: incomplete -> fail 2026-05-04 17:50:40,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:40,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d8bb0573a8210e130859 HTTP/1.1" 200 None 2026-05-04 17:50:40,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:41,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6920573a8210e12ccf3 HTTP/1.1" 200 None 2026-05-04 17:50:41,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:41,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d8bb0573a8210e130859 HTTP/1.1" 200 None 2026-05-04 17:50:41,177 - lava_callback - INFO - Completed processing callback for node 69f8d8bb0573a8210e130859 2026-05-04 17:50:43,029 - lava_callback - INFO - Received callback for node 69f6396c8234569b79a1f3d3 INFO: 172.20.0.1:51284 - "POST /node/69f6396c8234569b79a1f3d3 HTTP/1.0" 202 Accepted 2026-05-04 17:50:43,037 - lava_callback - INFO - Starting async job submit for node 69f6396c8234569b79a1f3d3 2026-05-04 17:50:43,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:43,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6396c8234569b79a1f3d3 HTTP/1.1" 200 None 2026-05-04 17:50:43,057 - lava_callback - DEBUG - Processing node 69f6396c8234569b79a1f3d3: baseline-arm64-baylibre 2026-05-04 17:50:43,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6396c8234569b79a1f3d3 2026-05-04 17:50:43,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:43,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6396c8234569b79a1f3d3 HTTP/1.1" 200 None 2026-05-04 17:50:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:43,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:50:43,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:43,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6396c8234569b79a1f3d3 HTTP/1.1" 200 None 2026-05-04 17:50:43,129 - lava_callback - ERROR - Error processing callback for node 69f6396c8234569b79a1f3d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50564 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:50:57,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:50:57,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35594 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:51:24,278 - lava_callback - INFO - Received callback for node 69f8dc7a0573a8210e130b08 INFO: 172.20.0.1:35598 - "POST /node/69f8dc7a0573a8210e130b08 HTTP/1.0" 202 Accepted 2026-05-04 17:51:24,286 - lava_callback - INFO - Starting async job submit for node 69f8dc7a0573a8210e130b08 2026-05-04 17:51:24,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:24,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dc7a0573a8210e130b08 HTTP/1.1" 200 None 2026-05-04 17:51:24,328 - lava_callback - DEBUG - Processing node 69f8dc7a0573a8210e130b08: baseline-arm64 2026-05-04 17:51:24,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:51:24,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:51:24,633 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8dc7a0573a8210e130b08/log.txt.gz 2026-05-04 17:51:24,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:51:24,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:51:24,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8dc7a0573a8210e130b08/lava-logs.yaml 2026-05-04 17:51:24,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:51:25,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:51:25,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8dc7a0573a8210e130b08/lava_callback.json.gz 2026-05-04 17:51:25,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:25,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dc7a0573a8210e130b08 HTTP/1.1" 200 None 2026-05-04 17:51:25,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:25,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:51:25,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:25,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dc7a0573a8210e130b08 HTTP/1.1" 200 None 2026-05-04 17:51:25,130 - lava_callback - INFO - Completed processing callback for node 69f8dc7a0573a8210e130b08 INFO: 172.20.0.1:35606 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:51:27,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:27,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 17:51:33,358 - lava_callback - INFO - Received callback for node 69f8dc760573a8210e130b05 INFO: 172.20.0.1:47844 - "POST /node/69f8dc760573a8210e130b05 HTTP/1.0" 202 Accepted 2026-05-04 17:51:33,368 - lava_callback - INFO - Starting async job submit for node 69f8dc760573a8210e130b05 2026-05-04 17:51:33,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:33,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dc760573a8210e130b05 HTTP/1.1" 200 None 2026-05-04 17:51:33,436 - lava_callback - DEBUG - Processing node 69f8dc760573a8210e130b05: baseline-arm64 2026-05-04 17:51:33,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:51:33,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:51:33,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8dc760573a8210e130b05/log.txt.gz 2026-05-04 17:51:33,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:51:34,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:51:34,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8dc760573a8210e130b05/lava-logs.yaml 2026-05-04 17:51:34,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:51:34,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:51:34,230 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8dc760573a8210e130b05/lava_callback.json.gz 2026-05-04 17:51:34,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:34,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dc760573a8210e130b05 HTTP/1.1" 200 None 2026-05-04 17:51:34,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:34,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:51:34,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:34,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dc760573a8210e130b05 HTTP/1.1" 200 None 2026-05-04 17:51:34,342 - lava_callback - INFO - Completed processing callback for node 69f8dc760573a8210e130b05 INFO: 172.20.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54886 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:51:57,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:51:57,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:52:07,163 - lava_callback - INFO - Received callback for node 69f639ba8234569b79a1f3f5 INFO: 172.20.0.1:46656 - "POST /node/69f639ba8234569b79a1f3f5 HTTP/1.0" 202 Accepted 2026-05-04 17:52:07,172 - lava_callback - INFO - Starting async job submit for node 69f639ba8234569b79a1f3f5 2026-05-04 17:52:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:52:07,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f639ba8234569b79a1f3f5 HTTP/1.1" 200 None 2026-05-04 17:52:07,194 - lava_callback - DEBUG - Processing node 69f639ba8234569b79a1f3f5: baseline-arm64-clabbe 2026-05-04 17:52:07,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f639ba8234569b79a1f3f5 2026-05-04 17:52:07,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:52:07,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f639ba8234569b79a1f3f5 HTTP/1.1" 200 None 2026-05-04 17:52:07,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:52:07,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:52:07,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:52:07,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f639ba8234569b79a1f3f5 HTTP/1.1" 200 None 2026-05-04 17:52:07,260 - lava_callback - ERROR - Error processing callback for node 69f639ba8234569b79a1f3f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44736 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:53:20,073 - lava_callback - INFO - Received callback for node 69f8da950573a8210e1309de INFO: 172.20.0.1:38308 - "POST /node/69f8da950573a8210e1309de HTTP/1.0" 202 Accepted 2026-05-04 17:53:20,080 - lava_callback - INFO - Starting async job submit for node 69f8da950573a8210e1309de 2026-05-04 17:53:20,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:20,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8da950573a8210e1309de HTTP/1.1" 200 None 2026-05-04 17:53:20,119 - lava_callback - DEBUG - Processing node 69f8da950573a8210e1309de: baseline-arm64 2026-05-04 17:53:20,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:53:20,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:53:20,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8da950573a8210e1309de/log.txt.gz 2026-05-04 17:53:20,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:53:21,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:53:21,177 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8da950573a8210e1309de/lava-logs.yaml 2026-05-04 17:53:21,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:53:21,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:53:21,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8da950573a8210e1309de/lava_callback.json.gz 2026-05-04 17:53:21,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:21,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8da950573a8210e1309de HTTP/1.1" 200 None 2026-05-04 17:53:21,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:21,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:53:21,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:21,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8da950573a8210e1309de HTTP/1.1" 200 None 2026-05-04 17:53:21,472 - lava_callback - INFO - Completed processing callback for node 69f8da950573a8210e1309de INFO: 172.20.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:53:27,222 - lava_callback - INFO - Received callback for node 69f63a038234569b79a1f428 INFO: 172.20.0.1:38326 - "POST /node/69f63a038234569b79a1f428 HTTP/1.0" 202 Accepted 2026-05-04 17:53:27,228 - lava_callback - INFO - Starting async job submit for node 69f63a038234569b79a1f428 2026-05-04 17:53:27,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:27,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63a038234569b79a1f428 HTTP/1.1" 200 None 2026-05-04 17:53:27,249 - lava_callback - DEBUG - Processing node 69f63a038234569b79a1f428: baseline-arm64-clabbe 2026-05-04 17:53:27,250 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f63a038234569b79a1f428 2026-05-04 17:53:27,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:27,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63a038234569b79a1f428 HTTP/1.1" 200 None 2026-05-04 17:53:27,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:27,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:53:27,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:27,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f63a038234569b79a1f428 HTTP/1.1" 200 None 2026-05-04 17:53:27,299 - lava_callback - ERROR - Error processing callback for node 69f63a038234569b79a1f428: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 17:53:27,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:53:27,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38564 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:54:27,236 - lava_callback - INFO - Received callback for node 69f63a4c8234569b79a1f447 INFO: 172.20.0.1:38578 - "POST /node/69f63a4c8234569b79a1f447 HTTP/1.0" 202 Accepted 2026-05-04 17:54:27,241 - lava_callback - INFO - Starting async job submit for node 69f63a4c8234569b79a1f447 2026-05-04 17:54:27,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:54:27,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63a4c8234569b79a1f447 HTTP/1.1" 200 None 2026-05-04 17:54:27,256 - lava_callback - DEBUG - Processing node 69f63a4c8234569b79a1f447: baseline-arm64-clabbe 2026-05-04 17:54:27,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f63a4c8234569b79a1f447 2026-05-04 17:54:27,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:54:27,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63a4c8234569b79a1f447 HTTP/1.1" 200 None 2026-05-04 17:54:27,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:54:27,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:54:27,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:54:27,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f63a4c8234569b79a1f447 HTTP/1.1" 200 None 2026-05-04 17:54:27,374 - lava_callback - ERROR - Error processing callback for node 69f63a4c8234569b79a1f447: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:55:13,820 - lava_callback - INFO - Received callback for node 69f8daed0573a8210e130a45 INFO: 172.20.0.1:41154 - "POST /node/69f8daed0573a8210e130a45 HTTP/1.0" 202 Accepted 2026-05-04 17:55:13,827 - lava_callback - INFO - Starting async job submit for node 69f8daed0573a8210e130a45 2026-05-04 17:55:13,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:13,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8daed0573a8210e130a45 HTTP/1.1" 200 None 2026-05-04 17:55:13,870 - lava_callback - DEBUG - Processing node 69f8daed0573a8210e130a45: baseline-nfs-arm64 2026-05-04 17:55:14,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:55:14,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:55:14,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8daed0573a8210e130a45/log.txt.gz 2026-05-04 17:55:14,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41164 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 17:55:15,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:55:15,309 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8daed0573a8210e130a45/lava-logs.yaml 2026-05-04 17:55:15,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:55:15,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:55:15,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8daed0573a8210e130a45/lava_callback.json.gz 2026-05-04 17:55:15,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:15,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8daed0573a8210e130a45 HTTP/1.1" 200 None 2026-05-04 17:55:15,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:15,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:55:15,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:15,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8daed0573a8210e130a45 HTTP/1.1" 200 None 2026-05-04 17:55:15,608 - lava_callback - INFO - Completed processing callback for node 69f8daed0573a8210e130a45 INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42636 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:55:27,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:27,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50744 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:55:47,378 - lava_callback - INFO - Received callback for node 69f63a958234569b79a1f47d INFO: 172.20.0.1:50760 - "POST /node/69f63a958234569b79a1f47d HTTP/1.0" 202 Accepted 2026-05-04 17:55:47,384 - lava_callback - INFO - Starting async job submit for node 69f63a958234569b79a1f47d 2026-05-04 17:55:47,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:47,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63a958234569b79a1f47d HTTP/1.1" 200 None 2026-05-04 17:55:47,398 - lava_callback - DEBUG - Processing node 69f63a958234569b79a1f47d: baseline-arm64-clabbe 2026-05-04 17:55:47,399 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f63a958234569b79a1f47d 2026-05-04 17:55:47,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:47,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63a958234569b79a1f47d HTTP/1.1" 200 None 2026-05-04 17:55:47,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:47,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:55:47,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:55:47,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f63a958234569b79a1f47d HTTP/1.1" 200 None 2026-05-04 17:55:47,447 - lava_callback - ERROR - Error processing callback for node 69f63a958234569b79a1f47d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59850 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:58:07,417 - lava_callback - INFO - Received callback for node 69f63b278234569b79a1f4c0 INFO: 172.20.0.1:59858 - "POST /node/69f63b278234569b79a1f4c0 HTTP/1.0" 202 Accepted 2026-05-04 17:58:07,423 - lava_callback - INFO - Starting async job submit for node 69f63b278234569b79a1f4c0 2026-05-04 17:58:07,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:07,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63b278234569b79a1f4c0 HTTP/1.1" 200 None 2026-05-04 17:58:07,438 - lava_callback - DEBUG - Processing node 69f63b278234569b79a1f4c0: baseline-arm64-clabbe 2026-05-04 17:58:07,439 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f63b278234569b79a1f4c0 2026-05-04 17:58:07,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:07,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63b278234569b79a1f4c0 HTTP/1.1" 200 None 2026-05-04 17:58:07,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:07,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:58:07,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:07,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f63b278234569b79a1f4c0 HTTP/1.1" 200 None 2026-05-04 17:58:07,496 - lava_callback - ERROR - Error processing callback for node 69f63b278234569b79a1f4c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39750 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:58:21,966 - lava_callback - INFO - Received callback for node 69f8de260573a8210e130c43 INFO: 172.20.0.1:39752 - "POST /node/69f8de260573a8210e130c43 HTTP/1.0" 202 Accepted 2026-05-04 17:58:21,973 - lava_callback - INFO - Starting async job submit for node 69f8de260573a8210e130c43 2026-05-04 17:58:21,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:21,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8de260573a8210e130c43 HTTP/1.1" 200 None 2026-05-04 17:58:21,991 - lava_callback - DEBUG - Processing node 69f8de260573a8210e130c43: baseline-nfs-arm64 2026-05-04 17:58:21,993 - lava_callback - WARNING - Failed to upload log 2026-05-04 17:58:21,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:58:22,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:58:22,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8de260573a8210e130c43/lava-logs.yaml 2026-05-04 17:58:22,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 17:58:22,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 17:58:22,181 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8de260573a8210e130c43/lava_callback.json.gz 2026-05-04 17:58:22,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:22,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8de260573a8210e130c43 HTTP/1.1" 200 None 2026-05-04 17:58:22,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:22,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 17:58:22,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:22,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8de260573a8210e130c43 HTTP/1.1" 200 None 2026-05-04 17:58:22,252 - lava_callback - INFO - Completed processing callback for node 69f8de260573a8210e130c43 INFO: 172.20.0.1:39766 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:58:27,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:58:27,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42142 - "GET / HTTP/1.0" 200 OK 2026-05-04 17:59:27,574 - lava_callback - INFO - Received callback for node 69f63b708234569b79a1f4ff INFO: 172.20.0.1:42158 - "POST /node/69f63b708234569b79a1f4ff HTTP/1.0" 202 Accepted 2026-05-04 17:59:27,580 - lava_callback - INFO - Starting async job submit for node 69f63b708234569b79a1f4ff 2026-05-04 17:59:27,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:59:27,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63b708234569b79a1f4ff HTTP/1.1" 200 None 2026-05-04 17:59:27,596 - lava_callback - DEBUG - Processing node 69f63b708234569b79a1f4ff: baseline-arm64-clabbe 2026-05-04 17:59:27,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f63b708234569b79a1f4ff 2026-05-04 17:59:27,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:59:27,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f63b708234569b79a1f4ff HTTP/1.1" 200 None 2026-05-04 17:59:27,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:59:27,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 17:59:27,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 17:59:27,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f63b708234569b79a1f4ff HTTP/1.1" 200 None 2026-05-04 17:59:27,657 - lava_callback - ERROR - Error processing callback for node 69f63b708234569b79a1f4ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53206 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:03:09,864 - lava_callback - INFO - Received callback for node 69f8df200573a8210e130cd3 INFO: 172.20.0.1:55820 - "POST /node/69f8df200573a8210e130cd3 HTTP/1.0" 202 Accepted 2026-05-04 18:03:09,871 - lava_callback - INFO - Starting async job submit for node 69f8df200573a8210e130cd3 2026-05-04 18:03:09,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:03:09,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8df200573a8210e130cd3 HTTP/1.1" 200 None 2026-05-04 18:03:09,915 - lava_callback - DEBUG - Processing node 69f8df200573a8210e130cd3: baseline-arm64 2026-05-04 18:03:10,049 - lava_callback - WARNING - Failed to upload log 2026-05-04 18:03:10,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:03:10,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:03:10,268 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8df200573a8210e130cd3/lava-logs.yaml 2026-05-04 18:03:10,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:03:10,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:03:10,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8df200573a8210e130cd3/lava_callback.json.gz 2026-05-04 18:03:10,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:03:10,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8df200573a8210e130cd3 HTTP/1.1" 200 None 2026-05-04 18:03:10,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:03:10,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:03:10,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:03:10,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8df200573a8210e130cd3 HTTP/1.1" 200 None 2026-05-04 18:03:10,584 - lava_callback - INFO - Completed processing callback for node 69f8df200573a8210e130cd3 INFO: 172.20.0.1:55834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60808 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:03:27,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:03:27,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43688 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:04:43,051 - lava_callback - INFO - Received callback for node 69f8df770573a8210e130d03 INFO: 172.20.0.1:43734 - "POST /node/69f8df770573a8210e130d03 HTTP/1.0" 202 Accepted 2026-05-04 18:04:43,058 - lava_callback - INFO - Starting async job submit for node 69f8df770573a8210e130d03 2026-05-04 18:04:43,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:04:43,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8df770573a8210e130d03 HTTP/1.1" 200 None 2026-05-04 18:04:43,104 - lava_callback - DEBUG - Processing node 69f8df770573a8210e130d03: baseline-arm64 2026-05-04 18:04:43,304 - lava_callback - WARNING - Failed to upload log 2026-05-04 18:04:43,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:04:43,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:04:43,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8df770573a8210e130d03/lava-logs.yaml 2026-05-04 18:04:43,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:04:43,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:04:43,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8df770573a8210e130d03/lava_callback.json.gz 2026-05-04 18:04:43,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:04:43,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8df770573a8210e130d03 HTTP/1.1" 200 None 2026-05-04 18:04:43,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:04:43,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:04:43,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:04:43,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8df770573a8210e130d03 HTTP/1.1" 200 None 2026-05-04 18:04:43,789 - lava_callback - INFO - Completed processing callback for node 69f8df770573a8210e130d03 INFO: 172.20.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41654 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:04:57,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:04:57,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41658 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:11:40,771 - lava_callback - INFO - Received callback for node 69f8e0780573a8210e130da2 INFO: 172.20.0.1:44676 - "POST /node/69f8e0780573a8210e130da2 HTTP/1.0" 202 Accepted 2026-05-04 18:11:40,777 - lava_callback - INFO - Starting async job submit for node 69f8e0780573a8210e130da2 2026-05-04 18:11:40,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:11:40,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e0780573a8210e130da2 HTTP/1.1" 200 None 2026-05-04 18:11:40,811 - lava_callback - DEBUG - Processing node 69f8e0780573a8210e130da2: baseline-arm64 2026-05-04 18:11:41,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:11:41,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:11:41,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e0780573a8210e130da2/log.txt.gz 2026-05-04 18:11:41,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:11:41,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:11:41,636 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e0780573a8210e130da2/lava-logs.yaml 2026-05-04 18:11:41,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:11:41,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:11:41,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e0780573a8210e130da2/lava_callback.json.gz 2026-05-04 18:11:41,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:11:41,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e0780573a8210e130da2 HTTP/1.1" 200 None 2026-05-04 18:11:41,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:11:41,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:11:41,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:11:41,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e0780573a8210e130da2 HTTP/1.1" 200 None 2026-05-04 18:11:41,883 - lava_callback - INFO - Completed processing callback for node 69f8e0780573a8210e130da2 INFO: 172.20.0.1:44678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:11:57,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:11:57,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49740 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:12:28,541 - lava_callback - INFO - Received callback for node 69f8dcd50573a8210e130b56 INFO: 172.20.0.1:49742 - "POST /node/69f8dcd50573a8210e130b56 HTTP/1.0" 202 Accepted 2026-05-04 18:12:28,549 - lava_callback - INFO - Starting async job submit for node 69f8dcd50573a8210e130b56 2026-05-04 18:12:28,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:28,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dcd50573a8210e130b56 HTTP/1.1" 200 None 2026-05-04 18:12:28,607 - lava_callback - DEBUG - Processing node 69f8dcd50573a8210e130b56: baseline-nfs-arm64 2026-05-04 18:12:29,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:12:29,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:12:29,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8dcd50573a8210e130b56/log.txt.gz 2026-05-04 18:12:30,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:12:30,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:12:30,858 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8dcd50573a8210e130b56/lava-logs.yaml 2026-05-04 18:12:30,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:12:31,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:12:31,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8dcd50573a8210e130b56/lava_callback.json.gz DEBUG: Setup failed for 69f8dcd50573a8210e130b56. Transitting job node result: incomplete -> fail 2026-05-04 18:12:31,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:31,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8dcd50573a8210e130b56 HTTP/1.1" 200 None 2026-05-04 18:12:31,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:31,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:12:31,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:31,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8dcd50573a8210e130b56 HTTP/1.1" 200 None 2026-05-04 18:12:31,348 - lava_callback - INFO - Completed processing callback for node 69f8dcd50573a8210e130b56 INFO: 172.20.0.1:34032 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:12:41,882 - lava_callback - INFO - Received callback for node 69f8e0e40573a8210e130de7 INFO: 172.20.0.1:48782 - "POST /node/69f8e0e40573a8210e130de7 HTTP/1.0" 202 Accepted 2026-05-04 18:12:41,890 - lava_callback - INFO - Starting async job submit for node 69f8e0e40573a8210e130de7 2026-05-04 18:12:41,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:41,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e0e40573a8210e130de7 HTTP/1.1" 200 None 2026-05-04 18:12:41,957 - lava_callback - DEBUG - Processing node 69f8e0e40573a8210e130de7: baseline-arm64-foundriesio 2026-05-04 18:12:42,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:12:43,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:12:43,037 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8e0e40573a8210e130de7/log.txt.gz 2026-05-04 18:12:43,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:12:43,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:12:43,753 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8e0e40573a8210e130de7/lava-logs.yaml 2026-05-04 18:12:43,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:12:43,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:12:43,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8e0e40573a8210e130de7/lava_callback.json.gz DEBUG: 69f8e0e40573a8210e130de7 Transitting job node result: pass -> incomplete 2026-05-04 18:12:43,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:43,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e0e40573a8210e130de7 HTTP/1.1" 200 None 2026-05-04 18:12:43,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:43,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:12:43,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:44,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e0e40573a8210e130de7 HTTP/1.1" 200 None 2026-05-04 18:12:44,004 - lava_callback - INFO - Completed processing callback for node 69f8e0e40573a8210e130de7 INFO: 172.20.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36184 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:12:57,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:12:58,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34056 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:20:53,762 - lava_callback - INFO - Received callback for node 69f8e1ac0573a8210e130e83 INFO: 172.20.0.1:57348 - "POST /node/69f8e1ac0573a8210e130e83 HTTP/1.0" 202 Accepted 2026-05-04 18:20:53,770 - lava_callback - INFO - Starting async job submit for node 69f8e1ac0573a8210e130e83 2026-05-04 18:20:53,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:20:53,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e1ac0573a8210e130e83 HTTP/1.1" 200 None 2026-05-04 18:20:53,825 - lava_callback - DEBUG - Processing node 69f8e1ac0573a8210e130e83: baseline-arm64 2026-05-04 18:20:54,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:20:54,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:20:54,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e1ac0573a8210e130e83/log.txt.gz 2026-05-04 18:20:54,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:20:54,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:20:54,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e1ac0573a8210e130e83/lava-logs.yaml 2026-05-04 18:20:54,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:20:54,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:20:54,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e1ac0573a8210e130e83/lava_callback.json.gz DEBUG: Setup failed for 69f8e1ac0573a8210e130e83. Transitting job node result: incomplete -> fail 2026-05-04 18:20:55,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:20:55,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e1ac0573a8210e130e83 HTTP/1.1" 200 None 2026-05-04 18:20:55,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:20:55,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:20:55,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:20:55,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e1ac0573a8210e130e83 HTTP/1.1" 200 None 2026-05-04 18:20:55,187 - lava_callback - INFO - Completed processing callback for node 69f8e1ac0573a8210e130e83 INFO: 172.20.0.1:57358 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:20:58,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:20:58,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50196 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:23:44,347 - lava_callback - INFO - Received callback for node 69f8e3c50573a8210e130f97 INFO: 172.20.0.1:55836 - "POST /node/69f8e3c50573a8210e130f97 HTTP/1.0" 202 Accepted 2026-05-04 18:23:44,353 - lava_callback - INFO - Starting async job submit for node 69f8e3c50573a8210e130f97 2026-05-04 18:23:44,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:23:44,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e3c50573a8210e130f97 HTTP/1.1" 200 None 2026-05-04 18:23:44,386 - lava_callback - DEBUG - Processing node 69f8e3c50573a8210e130f97: baseline-x86 2026-05-04 18:23:44,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:23:44,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:23:44,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69f8e3c50573a8210e130f97/log.txt.gz 2026-05-04 18:23:44,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:23:45,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:23:45,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69f8e3c50573a8210e130f97/lava-logs.yaml 2026-05-04 18:23:45,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:23:45,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:23:45,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69f8e3c50573a8210e130f97/lava_callback.json.gz 2026-05-04 18:23:45,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:23:45,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e3c50573a8210e130f97 HTTP/1.1" 200 None 2026-05-04 18:23:45,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:23:45,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6920573a8210e12ccf3 HTTP/1.1" 200 None 2026-05-04 18:23:45,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:23:45,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e3c50573a8210e130f97 HTTP/1.1" 200 None 2026-05-04 18:23:45,245 - lava_callback - INFO - Completed processing callback for node 69f8e3c50573a8210e130f97 INFO: 172.20.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42590 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:23:58,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:23:58,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60264 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:24:24,974 - lava_callback - INFO - Received callback for node 69f641558234569b79a1f571 INFO: 172.20.0.1:60268 - "POST /node/69f641558234569b79a1f571 HTTP/1.0" 202 Accepted 2026-05-04 18:24:24,979 - lava_callback - INFO - Starting async job submit for node 69f641558234569b79a1f571 2026-05-04 18:24:24,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:24:24,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f641558234569b79a1f571 HTTP/1.1" 200 None 2026-05-04 18:24:24,995 - lava_callback - DEBUG - Processing node 69f641558234569b79a1f571: baseline-arm64-baylibre 2026-05-04 18:24:24,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f641558234569b79a1f571 2026-05-04 18:24:24,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:24:25,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f641558234569b79a1f571 HTTP/1.1" 200 None 2026-05-04 18:24:25,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:24:25,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:24:25,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:24:25,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f641558234569b79a1f571 HTTP/1.1" 200 None 2026-05-04 18:24:25,048 - lava_callback - ERROR - Error processing callback for node 69f641558234569b79a1f571: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54414 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:25:48,594 - lava_callback - INFO - Received callback for node 69f6419a8234569b79a1f5a2 INFO: 172.20.0.1:54416 - "POST /node/69f6419a8234569b79a1f5a2 HTTP/1.0" 202 Accepted 2026-05-04 18:25:48,599 - lava_callback - INFO - Starting async job submit for node 69f6419a8234569b79a1f5a2 2026-05-04 18:25:48,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:25:48,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6419a8234569b79a1f5a2 HTTP/1.1" 200 None 2026-05-04 18:25:48,614 - lava_callback - DEBUG - Processing node 69f6419a8234569b79a1f5a2: baseline-arm-clabbe 2026-05-04 18:25:48,614 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6419a8234569b79a1f5a2 2026-05-04 18:25:48,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:25:48,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6419a8234569b79a1f5a2 HTTP/1.1" 200 None 2026-05-04 18:25:48,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:25:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-04 18:25:48,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:25:48,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6419a8234569b79a1f5a2 HTTP/1.1" 200 None 2026-05-04 18:25:48,660 - lava_callback - ERROR - Error processing callback for node 69f6419a8234569b79a1f5a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52204 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:27:28,623 - lava_callback - INFO - Received callback for node 69f642098234569b79a1f5ce INFO: 172.20.0.1:52218 - "POST /node/69f642098234569b79a1f5ce HTTP/1.0" 202 Accepted 2026-05-04 18:27:28,628 - lava_callback - INFO - Starting async job submit for node 69f642098234569b79a1f5ce 2026-05-04 18:27:28,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:27:28,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642098234569b79a1f5ce HTTP/1.1" 200 None 2026-05-04 18:27:28,644 - lava_callback - DEBUG - Processing node 69f642098234569b79a1f5ce: baseline-arm-clabbe 2026-05-04 18:27:28,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f642098234569b79a1f5ce 2026-05-04 18:27:28,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:27:28,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642098234569b79a1f5ce HTTP/1.1" 200 None 2026-05-04 18:27:28,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:27:28,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-04 18:27:28,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:27:28,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f642098234569b79a1f5ce HTTP/1.1" 200 None 2026-05-04 18:27:28,690 - lava_callback - ERROR - Error processing callback for node 69f642098234569b79a1f5ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:28:08,599 - lava_callback - INFO - Received callback for node 69f6422e8234569b79a1f5da INFO: 172.20.0.1:50644 - "POST /node/69f6422e8234569b79a1f5da HTTP/1.0" 202 Accepted 2026-05-04 18:28:08,604 - lava_callback - INFO - Starting async job submit for node 69f6422e8234569b79a1f5da 2026-05-04 18:28:08,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:08,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6422e8234569b79a1f5da HTTP/1.1" 200 None 2026-05-04 18:28:08,619 - lava_callback - DEBUG - Processing node 69f6422e8234569b79a1f5da: baseline-arm-clabbe 2026-05-04 18:28:08,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6422e8234569b79a1f5da 2026-05-04 18:28:08,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:08,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6422e8234569b79a1f5da HTTP/1.1" 200 None 2026-05-04 18:28:08,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:08,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-04 18:28:08,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:08,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6422e8234569b79a1f5da HTTP/1.1" 200 None 2026-05-04 18:28:08,688 - lava_callback - ERROR - Error processing callback for node 69f6422e8234569b79a1f5da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51146 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:28:48,652 - lava_callback - INFO - Received callback for node 69f642548234569b79a1f5ea INFO: 172.20.0.1:51154 - "POST /node/69f642548234569b79a1f5ea HTTP/1.0" 202 Accepted 2026-05-04 18:28:48,657 - lava_callback - INFO - Starting async job submit for node 69f642548234569b79a1f5ea 2026-05-04 18:28:48,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:48,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642548234569b79a1f5ea HTTP/1.1" 200 None 2026-05-04 18:28:48,685 - lava_callback - DEBUG - Processing node 69f642548234569b79a1f5ea: baseline-arm-clabbe 2026-05-04 18:28:48,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f642548234569b79a1f5ea 2026-05-04 18:28:48,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:48,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642548234569b79a1f5ea HTTP/1.1" 200 None 2026-05-04 18:28:48,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:48,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-04 18:28:48,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:48,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f642548234569b79a1f5ea HTTP/1.1" 200 None 2026-05-04 18:28:48,731 - lava_callback - ERROR - Error processing callback for node 69f642548234569b79a1f5ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-04 18:28:50,333 - lava_callback - INFO - Received callback for node 69f8e1210573a8210e130e09 INFO: 172.20.0.1:51574 - "POST /node/69f8e1210573a8210e130e09 HTTP/1.0" 202 Accepted 2026-05-04 18:28:50,340 - lava_callback - INFO - Starting async job submit for node 69f8e1210573a8210e130e09 2026-05-04 18:28:50,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:50,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e1210573a8210e130e09 HTTP/1.1" 200 None 2026-05-04 18:28:50,413 - lava_callback - DEBUG - Processing node 69f8e1210573a8210e130e09: ltp-smoke 2026-05-04 18:28:50,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:28:51,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:28:51,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8e1210573a8210e130e09/log.txt.gz 2026-05-04 18:28:51,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:28:51,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:28:51,493 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8e1210573a8210e130e09/lava-logs.yaml 2026-05-04 18:28:51,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:28:51,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:28:51,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8e1210573a8210e130e09/lava_callback.json.gz 2026-05-04 18:28:51,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:51,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e1210573a8210e130e09 HTTP/1.1" 200 None 2026-05-04 18:28:51,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:51,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c66b0573a8210e12ccc7 HTTP/1.1" 200 None 2026-05-04 18:28:51,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:51,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e1210573a8210e130e09 HTTP/1.1" 200 None 2026-05-04 18:28:51,951 - lava_callback - INFO - Completed processing callback for node 69f8e1210573a8210e130e09 INFO: 172.20.0.1:51582 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:28:57,699 - lava_callback - INFO - Received callback for node 69f8e17a0573a8210e130e41 INFO: 172.20.0.1:51588 - "POST /node/69f8e17a0573a8210e130e41 HTTP/1.0" 202 Accepted 2026-05-04 18:28:57,706 - lava_callback - INFO - Starting async job submit for node 69f8e17a0573a8210e130e41 2026-05-04 18:28:57,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:57,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e17a0573a8210e130e41 HTTP/1.1" 200 None 2026-05-04 18:28:57,773 - lava_callback - DEBUG - Processing node 69f8e17a0573a8210e130e41: baseline-arm 2026-05-04 18:28:58,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:58,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 18:28:58,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:28:58,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:28:58,491 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8e17a0573a8210e130e41/log.txt.gz 2026-05-04 18:28:58,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:28:59,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:28:59,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8e17a0573a8210e130e41/lava-logs.yaml 2026-05-04 18:28:59,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:28:59,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:28:59,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8e17a0573a8210e130e41/lava_callback.json.gz DEBUG: Setup failed for 69f8e17a0573a8210e130e41. Transitting job node result: incomplete -> fail 2026-05-04 18:28:59,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:59,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e17a0573a8210e130e41 HTTP/1.1" 200 None 2026-05-04 18:28:59,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:59,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 18:28:59,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:28:59,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e17a0573a8210e130e41 HTTP/1.1" 200 None 2026-05-04 18:28:59,609 - lava_callback - INFO - Completed processing callback for node 69f8e17a0573a8210e130e41 INFO: 172.20.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39712 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:29:28,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:29:28,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48342 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:30:48,843 - lava_callback - INFO - Received callback for node 69f642c28234569b79a1f60e INFO: 172.20.0.1:48352 - "POST /node/69f642c28234569b79a1f60e HTTP/1.0" 202 Accepted 2026-05-04 18:30:48,848 - lava_callback - INFO - Starting async job submit for node 69f642c28234569b79a1f60e 2026-05-04 18:30:48,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:30:48,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642c28234569b79a1f60e HTTP/1.1" 200 None 2026-05-04 18:30:48,889 - lava_callback - DEBUG - Processing node 69f642c28234569b79a1f60e: baseline-arm-clabbe 2026-05-04 18:30:48,889 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f642c28234569b79a1f60e 2026-05-04 18:30:48,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:30:48,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642c28234569b79a1f60e HTTP/1.1" 200 None 2026-05-04 18:30:48,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:30:48,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380a62fa6ff8e8ca8e094 HTTP/1.1" 200 None 2026-05-04 18:30:48,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:30:48,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f642c28234569b79a1f60e HTTP/1.1" 200 None 2026-05-04 18:30:48,933 - lava_callback - ERROR - Error processing callback for node 69f642c28234569b79a1f60e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41034 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:31:25,345 - lava_callback - INFO - Received callback for node 69f642ed8234569b79a1f61e INFO: 172.20.0.1:41050 - "POST /node/69f642ed8234569b79a1f61e HTTP/1.0" 202 Accepted 2026-05-04 18:31:25,351 - lava_callback - INFO - Starting async job submit for node 69f642ed8234569b79a1f61e 2026-05-04 18:31:25,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:31:25,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642ed8234569b79a1f61e HTTP/1.1" 200 None 2026-05-04 18:31:25,366 - lava_callback - DEBUG - Processing node 69f642ed8234569b79a1f61e: baseline-arm64-baylibre 2026-05-04 18:31:25,366 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f642ed8234569b79a1f61e 2026-05-04 18:31:25,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:31:25,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f642ed8234569b79a1f61e HTTP/1.1" 200 None 2026-05-04 18:31:25,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:31:25,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:31:25,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:31:25,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f642ed8234569b79a1f61e HTTP/1.1" 200 None 2026-05-04 18:31:25,423 - lava_callback - ERROR - Error processing callback for node 69f642ed8234569b79a1f61e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:32:45,444 - lava_callback - INFO - Received callback for node 69f643398234569b79a1f63d INFO: 172.20.0.1:53908 - "POST /node/69f643398234569b79a1f63d HTTP/1.0" 202 Accepted 2026-05-04 18:32:45,449 - lava_callback - INFO - Starting async job submit for node 69f643398234569b79a1f63d 2026-05-04 18:32:45,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:32:45,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f643398234569b79a1f63d HTTP/1.1" 200 None 2026-05-04 18:32:45,465 - lava_callback - DEBUG - Processing node 69f643398234569b79a1f63d: baseline-arm64-baylibre 2026-05-04 18:32:45,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f643398234569b79a1f63d 2026-05-04 18:32:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:32:45,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f643398234569b79a1f63d HTTP/1.1" 200 None 2026-05-04 18:32:45,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:32:45,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:32:45,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:32:45,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f643398234569b79a1f63d HTTP/1.1" 200 None 2026-05-04 18:32:45,522 - lava_callback - ERROR - Error processing callback for node 69f643398234569b79a1f63d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60864 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:33:45,384 - lava_callback - INFO - Received callback for node 69f643838234569b79a1f66d INFO: 172.20.0.1:45546 - "POST /node/69f643838234569b79a1f66d HTTP/1.0" 202 Accepted 2026-05-04 18:33:45,389 - lava_callback - INFO - Starting async job submit for node 69f643838234569b79a1f66d 2026-05-04 18:33:45,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:33:45,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f643838234569b79a1f66d HTTP/1.1" 200 None 2026-05-04 18:33:45,404 - lava_callback - DEBUG - Processing node 69f643838234569b79a1f66d: baseline-arm64-baylibre 2026-05-04 18:33:45,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f643838234569b79a1f66d 2026-05-04 18:33:45,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:33:45,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f643838234569b79a1f66d HTTP/1.1" 200 None 2026-05-04 18:33:45,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:33:45,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:33:45,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:33:45,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f643838234569b79a1f66d HTTP/1.1" 200 None 2026-05-04 18:33:45,457 - lava_callback - ERROR - Error processing callback for node 69f643838234569b79a1f66d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46764 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:35:03,242 - lava_callback - INFO - Received callback for node 69f8e6c30573a8210e1311e4 INFO: 172.20.0.1:33326 - "POST /node/69f8e6c30573a8210e1311e4 HTTP/1.0" 202 Accepted 2026-05-04 18:35:03,248 - lava_callback - INFO - Starting async job submit for node 69f8e6c30573a8210e1311e4 2026-05-04 18:35:03,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:03,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e6c30573a8210e1311e4 HTTP/1.1" 200 None 2026-05-04 18:35:03,265 - lava_callback - DEBUG - Processing node 69f8e6c30573a8210e1311e4: baseline-nfs-arm64 2026-05-04 18:35:03,266 - lava_callback - WARNING - Failed to upload log 2026-05-04 18:35:03,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:35:03,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:35:03,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e6c30573a8210e1311e4/lava-logs.yaml 2026-05-04 18:35:03,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:35:03,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:35:03,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e6c30573a8210e1311e4/lava_callback.json.gz 2026-05-04 18:35:03,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:03,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e6c30573a8210e1311e4 HTTP/1.1" 200 None 2026-05-04 18:35:03,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:03,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:35:03,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:03,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e6c30573a8210e1311e4 HTTP/1.1" 200 None 2026-05-04 18:35:03,584 - lava_callback - INFO - Completed processing callback for node 69f8e6c30573a8210e1311e4 2026-05-04 18:35:05,549 - lava_callback - INFO - Received callback for node 69f643cc8234569b79a1f68e INFO: 172.20.0.1:33336 - "POST /node/69f643cc8234569b79a1f68e HTTP/1.0" 202 Accepted 2026-05-04 18:35:05,555 - lava_callback - INFO - Starting async job submit for node 69f643cc8234569b79a1f68e 2026-05-04 18:35:05,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:05,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f643cc8234569b79a1f68e HTTP/1.1" 200 None 2026-05-04 18:35:05,581 - lava_callback - DEBUG - Processing node 69f643cc8234569b79a1f68e: baseline-arm64-baylibre 2026-05-04 18:35:05,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f643cc8234569b79a1f68e 2026-05-04 18:35:05,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:05,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f643cc8234569b79a1f68e HTTP/1.1" 200 None 2026-05-04 18:35:05,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:05,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:35:05,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:05,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f643cc8234569b79a1f68e HTTP/1.1" 200 None 2026-05-04 18:35:05,625 - lava_callback - ERROR - Error processing callback for node 69f643cc8234569b79a1f68e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:35:28,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:35:28,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:36:25,625 - lava_callback - INFO - Received callback for node 69f644158234569b79a1f6be INFO: 172.20.0.1:40102 - "POST /node/69f644158234569b79a1f6be HTTP/1.0" 202 Accepted 2026-05-04 18:36:25,631 - lava_callback - INFO - Starting async job submit for node 69f644158234569b79a1f6be 2026-05-04 18:36:25,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:36:25,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644158234569b79a1f6be HTTP/1.1" 200 None 2026-05-04 18:36:25,650 - lava_callback - DEBUG - Processing node 69f644158234569b79a1f6be: baseline-arm64-baylibre 2026-05-04 18:36:25,651 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f644158234569b79a1f6be 2026-05-04 18:36:25,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:36:25,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644158234569b79a1f6be HTTP/1.1" 200 None 2026-05-04 18:36:25,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:36:25,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:36:25,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:36:25,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f644158234569b79a1f6be HTTP/1.1" 200 None 2026-05-04 18:36:25,697 - lava_callback - ERROR - Error processing callback for node 69f644158234569b79a1f6be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:37:29,069 - lava_callback - INFO - Received callback for node 69f644628234569b79a1f6de INFO: 172.20.0.1:50844 - "POST /node/69f644628234569b79a1f6de HTTP/1.0" 202 Accepted 2026-05-04 18:37:29,074 - lava_callback - INFO - Starting async job submit for node 69f644628234569b79a1f6de 2026-05-04 18:37:29,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:37:29,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644628234569b79a1f6de HTTP/1.1" 200 None 2026-05-04 18:37:29,090 - lava_callback - DEBUG - Processing node 69f644628234569b79a1f6de: baseline-arm64-clabbe 2026-05-04 18:37:29,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f644628234569b79a1f6de 2026-05-04 18:37:29,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:37:29,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644628234569b79a1f6de HTTP/1.1" 200 None 2026-05-04 18:37:29,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:37:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:37:29,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:37:29,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f644628234569b79a1f6de HTTP/1.1" 200 None 2026-05-04 18:37:29,141 - lava_callback - ERROR - Error processing callback for node 69f644628234569b79a1f6de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42208 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:38:20,333 - lava_callback - INFO - Received callback for node 69f8e7680573a8210e131262 INFO: 172.20.0.1:52758 - "POST /node/69f8e7680573a8210e131262 HTTP/1.0" 202 Accepted 2026-05-04 18:38:20,340 - lava_callback - INFO - Starting async job submit for node 69f8e7680573a8210e131262 2026-05-04 18:38:20,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:20,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e7680573a8210e131262 HTTP/1.1" 200 None 2026-05-04 18:38:20,384 - lava_callback - DEBUG - Processing node 69f8e7680573a8210e131262: baseline-arm64 2026-05-04 18:38:20,537 - lava_callback - WARNING - Failed to upload log 2026-05-04 18:38:20,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:38:20,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:38:20,763 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e7680573a8210e131262/lava-logs.yaml 2026-05-04 18:38:20,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:38:20,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:38:20,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e7680573a8210e131262/lava_callback.json.gz 2026-05-04 18:38:20,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:20,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e7680573a8210e131262 HTTP/1.1" 200 None 2026-05-04 18:38:20,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:20,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:38:20,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:20,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e7680573a8210e131262 HTTP/1.1" 200 None 2026-05-04 18:38:21,021 - lava_callback - INFO - Completed processing callback for node 69f8e7680573a8210e131262 INFO: 172.20.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52766 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:38:28,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:28,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45510 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:38:49,087 - lava_callback - INFO - Received callback for node 69f644ab8234569b79a1f711 INFO: 172.20.0.1:45512 - "POST /node/69f644ab8234569b79a1f711 HTTP/1.0" 202 Accepted 2026-05-04 18:38:49,093 - lava_callback - INFO - Starting async job submit for node 69f644ab8234569b79a1f711 2026-05-04 18:38:49,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:49,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644ab8234569b79a1f711 HTTP/1.1" 200 None 2026-05-04 18:38:49,108 - lava_callback - DEBUG - Processing node 69f644ab8234569b79a1f711: baseline-arm64-clabbe 2026-05-04 18:38:49,108 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f644ab8234569b79a1f711 2026-05-04 18:38:49,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:49,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644ab8234569b79a1f711 HTTP/1.1" 200 None 2026-05-04 18:38:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:49,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:38:49,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:38:49,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f644ab8234569b79a1f711 HTTP/1.1" 200 None 2026-05-04 18:38:49,183 - lava_callback - ERROR - Error processing callback for node 69f644ab8234569b79a1f711: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44248 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:39:49,165 - lava_callback - INFO - Received callback for node 69f644f28234569b79a1f72f INFO: 172.20.0.1:44254 - "POST /node/69f644f28234569b79a1f72f HTTP/1.0" 202 Accepted 2026-05-04 18:39:49,171 - lava_callback - INFO - Starting async job submit for node 69f644f28234569b79a1f72f 2026-05-04 18:39:49,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:39:49,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644f28234569b79a1f72f HTTP/1.1" 200 None 2026-05-04 18:39:49,185 - lava_callback - DEBUG - Processing node 69f644f28234569b79a1f72f: baseline-arm64-clabbe 2026-05-04 18:39:49,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f644f28234569b79a1f72f 2026-05-04 18:39:49,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:39:49,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f644f28234569b79a1f72f HTTP/1.1" 200 None 2026-05-04 18:39:49,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:39:49,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:39:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:39:49,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f644f28234569b79a1f72f HTTP/1.1" 200 None 2026-05-04 18:39:49,273 - lava_callback - ERROR - Error processing callback for node 69f644f28234569b79a1f72f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34568 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:40:10,406 - lava_callback - INFO - Received callback for node 69f8e7bd0573a8210e13128b INFO: 172.20.0.1:39954 - "POST /node/69f8e7bd0573a8210e13128b HTTP/1.0" 202 Accepted 2026-05-04 18:40:10,414 - lava_callback - INFO - Starting async job submit for node 69f8e7bd0573a8210e13128b 2026-05-04 18:40:10,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:40:10,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e7bd0573a8210e13128b HTTP/1.1" 200 None 2026-05-04 18:40:10,457 - lava_callback - DEBUG - Processing node 69f8e7bd0573a8210e13128b: baseline-arm64 2026-05-04 18:40:10,660 - lava_callback - WARNING - Failed to upload log 2026-05-04 18:40:10,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:40:10,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:40:10,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e7bd0573a8210e13128b/lava-logs.yaml 2026-05-04 18:40:10,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:40:11,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:40:11,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e7bd0573a8210e13128b/lava_callback.json.gz 2026-05-04 18:40:11,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:40:11,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e7bd0573a8210e13128b HTTP/1.1" 200 None 2026-05-04 18:40:11,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:40:11,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:40:11,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:40:11,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e7bd0573a8210e13128b HTTP/1.1" 200 None 2026-05-04 18:40:11,192 - lava_callback - INFO - Completed processing callback for node 69f8e7bd0573a8210e13128b INFO: 172.20.0.1:39964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45742 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:40:28,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:40:28,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:41:09,168 - lava_callback - INFO - Received callback for node 69f6453c8234569b79a1f750 INFO: 172.20.0.1:33478 - "POST /node/69f6453c8234569b79a1f750 HTTP/1.0" 202 Accepted 2026-05-04 18:41:09,174 - lava_callback - INFO - Starting async job submit for node 69f6453c8234569b79a1f750 2026-05-04 18:41:09,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:09,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6453c8234569b79a1f750 HTTP/1.1" 200 None 2026-05-04 18:41:09,190 - lava_callback - DEBUG - Processing node 69f6453c8234569b79a1f750: baseline-arm64-clabbe 2026-05-04 18:41:09,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6453c8234569b79a1f750 2026-05-04 18:41:09,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:09,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6453c8234569b79a1f750 HTTP/1.1" 200 None 2026-05-04 18:41:09,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:09,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:41:09,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:09,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6453c8234569b79a1f750 HTTP/1.1" 200 None 2026-05-04 18:41:09,239 - lava_callback - ERROR - Error processing callback for node 69f6453c8234569b79a1f750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57716 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:41:41,672 - lava_callback - INFO - Received callback for node 69f8e4720573a8210e13101a INFO: 172.20.0.1:51832 - "POST /node/69f8e4720573a8210e13101a HTTP/1.0" 202 Accepted 2026-05-04 18:41:41,679 - lava_callback - INFO - Starting async job submit for node 69f8e4720573a8210e13101a 2026-05-04 18:41:41,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:41,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e4720573a8210e13101a HTTP/1.1" 200 None 2026-05-04 18:41:41,718 - lava_callback - DEBUG - Processing node 69f8e4720573a8210e13101a: baseline-arm64 2026-05-04 18:41:42,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:41:42,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:41:42,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e4720573a8210e13101a/log.txt.gz 2026-05-04 18:41:42,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:41:42,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:41:42,811 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e4720573a8210e13101a/lava-logs.yaml 2026-05-04 18:41:42,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:41:42,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:41:42,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e4720573a8210e13101a/lava_callback.json.gz 2026-05-04 18:41:43,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:43,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e4720573a8210e13101a HTTP/1.1" 200 None 2026-05-04 18:41:43,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:43,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:41:43,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:43,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e4720573a8210e13101a HTTP/1.1" 200 None 2026-05-04 18:41:43,182 - lava_callback - INFO - Completed processing callback for node 69f8e4720573a8210e13101a INFO: 172.20.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:41:58,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:41:58,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:43:49,298 - lava_callback - INFO - Received callback for node 69f645cf8234569b79a1f7a9 INFO: 172.20.0.1:49590 - "POST /node/69f645cf8234569b79a1f7a9 HTTP/1.0" 202 Accepted 2026-05-04 18:43:49,304 - lava_callback - INFO - Starting async job submit for node 69f645cf8234569b79a1f7a9 2026-05-04 18:43:49,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:43:49,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f645cf8234569b79a1f7a9 HTTP/1.1" 200 None 2026-05-04 18:43:49,319 - lava_callback - DEBUG - Processing node 69f645cf8234569b79a1f7a9: baseline-arm64-clabbe 2026-05-04 18:43:49,319 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f645cf8234569b79a1f7a9 2026-05-04 18:43:49,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:43:49,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f645cf8234569b79a1f7a9 HTTP/1.1" 200 None 2026-05-04 18:43:49,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:43:49,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:43:49,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:43:49,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f645cf8234569b79a1f7a9 HTTP/1.1" 200 None 2026-05-04 18:43:49,366 - lava_callback - ERROR - Error processing callback for node 69f645cf8234569b79a1f7a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45202 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:44:10,006 - lava_callback - INFO - Received callback for node 69f8e8100573a8210e1312c0 INFO: 172.20.0.1:59544 - "POST /node/69f8e8100573a8210e1312c0 HTTP/1.0" 202 Accepted 2026-05-04 18:44:10,012 - lava_callback - INFO - Starting async job submit for node 69f8e8100573a8210e1312c0 2026-05-04 18:44:10,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:10,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e8100573a8210e1312c0 HTTP/1.1" 200 None 2026-05-04 18:44:10,072 - lava_callback - DEBUG - Processing node 69f8e8100573a8210e1312c0: baseline-arm64 2026-05-04 18:44:10,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:44:10,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:44:10,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e8100573a8210e1312c0/log.txt.gz 2026-05-04 18:44:10,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:44:10,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:44:10,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e8100573a8210e1312c0/lava-logs.yaml 2026-05-04 18:44:10,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:44:10,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:44:10,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e8100573a8210e1312c0/lava_callback.json.gz 2026-05-04 18:44:11,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:11,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e8100573a8210e1312c0 HTTP/1.1" 200 None 2026-05-04 18:44:11,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:11,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:44:11,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:11,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e8100573a8210e1312c0 HTTP/1.1" 200 None 2026-05-04 18:44:11,121 - lava_callback - INFO - Completed processing callback for node 69f8e8100573a8210e1312c0 2026-05-04 18:44:11,958 - lava_callback - INFO - Received callback for node 69f8e5c70573a8210e13111a INFO: 172.20.0.1:59548 - "POST /node/69f8e5c70573a8210e13111a HTTP/1.0" 202 Accepted 2026-05-04 18:44:11,965 - lava_callback - INFO - Starting async job submit for node 69f8e5c70573a8210e13111a 2026-05-04 18:44:11,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:12,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e5c70573a8210e13111a HTTP/1.1" 200 None 2026-05-04 18:44:12,005 - lava_callback - DEBUG - Processing node 69f8e5c70573a8210e13111a: baseline-nfs-arm64 2026-05-04 18:44:12,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:44:12,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:44:12,645 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e5c70573a8210e13111a/log.txt.gz 2026-05-04 18:44:12,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:44:13,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:44:13,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e5c70573a8210e13111a/lava-logs.yaml 2026-05-04 18:44:13,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:44:13,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:44:13,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e5c70573a8210e13111a/lava_callback.json.gz 2026-05-04 18:44:13,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:13,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e5c70573a8210e13111a HTTP/1.1" 200 None 2026-05-04 18:44:13,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:13,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:44:13,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:13,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e5c70573a8210e13111a HTTP/1.1" 200 None 2026-05-04 18:44:13,402 - lava_callback - INFO - Completed processing callback for node 69f8e5c70573a8210e13111a INFO: 172.20.0.1:59562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45980 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:44:28,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:28,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:44:49,399 - lava_callback - INFO - Received callback for node 69f6461a8234569b79a1f7de INFO: 172.20.0.1:41330 - "POST /node/69f6461a8234569b79a1f7de HTTP/1.0" 202 Accepted 2026-05-04 18:44:49,405 - lava_callback - INFO - Starting async job submit for node 69f6461a8234569b79a1f7de 2026-05-04 18:44:49,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:49,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6461a8234569b79a1f7de HTTP/1.1" 200 None 2026-05-04 18:44:49,422 - lava_callback - DEBUG - Processing node 69f6461a8234569b79a1f7de: baseline-arm64-clabbe 2026-05-04 18:44:49,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6461a8234569b79a1f7de 2026-05-04 18:44:49,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:49,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6461a8234569b79a1f7de HTTP/1.1" 200 None 2026-05-04 18:44:49,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:49,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:44:49,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:44:49,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6461a8234569b79a1f7de HTTP/1.1" 200 None 2026-05-04 18:44:49,469 - lava_callback - ERROR - Error processing callback for node 69f6461a8234569b79a1f7de: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43390 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:45:46,240 - lava_callback - INFO - Received callback for node 69f646508234569b79a1f805 INFO: 172.20.0.1:34724 - "POST /node/69f646508234569b79a1f805 HTTP/1.0" 202 Accepted 2026-05-04 18:45:46,246 - lava_callback - INFO - Starting async job submit for node 69f646508234569b79a1f805 2026-05-04 18:45:46,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:45:46,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646508234569b79a1f805 HTTP/1.1" 200 None 2026-05-04 18:45:46,261 - lava_callback - DEBUG - Processing node 69f646508234569b79a1f805: baseline-arm-baylibre 2026-05-04 18:45:46,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f646508234569b79a1f805 2026-05-04 18:45:46,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:45:46,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646508234569b79a1f805 HTTP/1.1" 200 None 2026-05-04 18:45:46,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:45:46,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:45:46,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:45:46,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f646508234569b79a1f805 HTTP/1.1" 200 None 2026-05-04 18:45:46,318 - lava_callback - ERROR - Error processing callback for node 69f646508234569b79a1f805: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43002 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:46:26,160 - lava_callback - INFO - Received callback for node 69f646808234569b79a1f811 INFO: 172.20.0.1:43014 - "POST /node/69f646808234569b79a1f811 HTTP/1.0" 202 Accepted 2026-05-04 18:46:26,166 - lava_callback - INFO - Starting async job submit for node 69f646808234569b79a1f811 2026-05-04 18:46:26,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:46:26,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646808234569b79a1f811 HTTP/1.1" 200 None 2026-05-04 18:46:26,184 - lava_callback - DEBUG - Processing node 69f646808234569b79a1f811: baseline-arm64-baylibre 2026-05-04 18:46:26,184 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f646808234569b79a1f811 2026-05-04 18:46:26,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:46:26,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646808234569b79a1f811 HTTP/1.1" 200 None 2026-05-04 18:46:26,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:46:26,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:46:26,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:46:26,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f646808234569b79a1f811 HTTP/1.1" 200 None 2026-05-04 18:46:26,231 - lava_callback - ERROR - Error processing callback for node 69f646808234569b79a1f811: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45836 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:47:26,193 - lava_callback - INFO - Received callback for node 69f646bb8234569b79a1f836 INFO: 172.20.0.1:45838 - "POST /node/69f646bb8234569b79a1f836 HTTP/1.0" 202 Accepted 2026-05-04 18:47:26,199 - lava_callback - INFO - Starting async job submit for node 69f646bb8234569b79a1f836 2026-05-04 18:47:26,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:47:26,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646bb8234569b79a1f836 HTTP/1.1" 200 None 2026-05-04 18:47:26,214 - lava_callback - DEBUG - Processing node 69f646bb8234569b79a1f836: baseline-arm-baylibre 2026-05-04 18:47:26,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f646bb8234569b79a1f836 2026-05-04 18:47:26,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:47:26,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646bb8234569b79a1f836 HTTP/1.1" 200 None 2026-05-04 18:47:26,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:47:26,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:47:26,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:47:26,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f646bb8234569b79a1f836 HTTP/1.1" 200 None 2026-05-04 18:47:26,268 - lava_callback - ERROR - Error processing callback for node 69f646bb8234569b79a1f836: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:48:06,177 - lava_callback - INFO - Received callback for node 69f646df8234569b79a1f849 INFO: 172.20.0.1:35936 - "POST /node/69f646df8234569b79a1f849 HTTP/1.0" 202 Accepted 2026-05-04 18:48:06,183 - lava_callback - INFO - Starting async job submit for node 69f646df8234569b79a1f849 2026-05-04 18:48:06,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:06,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646df8234569b79a1f849 HTTP/1.1" 200 None 2026-05-04 18:48:06,201 - lava_callback - DEBUG - Processing node 69f646df8234569b79a1f849: baseline-arm-baylibre 2026-05-04 18:48:06,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f646df8234569b79a1f849 2026-05-04 18:48:06,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:06,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f646df8234569b79a1f849 HTTP/1.1" 200 None 2026-05-04 18:48:06,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:06,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:48:06,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:06,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f646df8234569b79a1f849 HTTP/1.1" 200 None 2026-05-04 18:48:06,255 - lava_callback - ERROR - Error processing callback for node 69f646df8234569b79a1f849: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40716 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:48:46,292 - lava_callback - INFO - Received callback for node 69f647038234569b79a1f85e INFO: 172.20.0.1:46210 - "POST /node/69f647038234569b79a1f85e HTTP/1.0" 202 Accepted 2026-05-04 18:48:46,298 - lava_callback - INFO - Starting async job submit for node 69f647038234569b79a1f85e 2026-05-04 18:48:46,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:46,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f647038234569b79a1f85e HTTP/1.1" 200 None 2026-05-04 18:48:46,330 - lava_callback - DEBUG - Processing node 69f647038234569b79a1f85e: baseline-arm-baylibre 2026-05-04 18:48:46,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f647038234569b79a1f85e 2026-05-04 18:48:46,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:46,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f647038234569b79a1f85e HTTP/1.1" 200 None 2026-05-04 18:48:46,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:46,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:48:46,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:48:46,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f647038234569b79a1f85e HTTP/1.1" 200 None 2026-05-04 18:48:46,379 - lava_callback - ERROR - Error processing callback for node 69f647038234569b79a1f85e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38546 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:49:26,250 - lava_callback - INFO - Received callback for node 69f647288234569b79a1f867 INFO: 172.20.0.1:38558 - "POST /node/69f647288234569b79a1f867 HTTP/1.0" 202 Accepted 2026-05-04 18:49:26,256 - lava_callback - INFO - Starting async job submit for node 69f647288234569b79a1f867 2026-05-04 18:49:26,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f647288234569b79a1f867 HTTP/1.1" 200 None 2026-05-04 18:49:26,270 - lava_callback - DEBUG - Processing node 69f647288234569b79a1f867: baseline-arm-baylibre 2026-05-04 18:49:26,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f647288234569b79a1f867 2026-05-04 18:49:26,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:26,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f647288234569b79a1f867 HTTP/1.1" 200 None 2026-05-04 18:49:26,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:26,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:49:26,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:26,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f647288234569b79a1f867 HTTP/1.1" 200 None 2026-05-04 18:49:26,328 - lava_callback - ERROR - Error processing callback for node 69f647288234569b79a1f867: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35812 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:49:42,843 - lava_callback - INFO - Received callback for node 69f8e8d20573a8210e13135f INFO: 172.20.0.1:35010 - "POST /node/69f8e8d20573a8210e13135f HTTP/1.0" 202 Accepted 2026-05-04 18:49:42,852 - lava_callback - INFO - Starting async job submit for node 69f8e8d20573a8210e13135f 2026-05-04 18:49:42,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:42,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e8d20573a8210e13135f HTTP/1.1" 200 None 2026-05-04 18:49:42,930 - lava_callback - DEBUG - Processing node 69f8e8d20573a8210e13135f: baseline-arm64-foundriesio 2026-05-04 18:49:44,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:49:44,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:49:44,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8e8d20573a8210e13135f/log.txt.gz 2026-05-04 18:49:44,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:49:45,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:49:45,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8e8d20573a8210e13135f/lava-logs.yaml 2026-05-04 18:49:45,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:49:45,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:49:45,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69f8e8d20573a8210e13135f/lava_callback.json.gz DEBUG: Setup failed for 69f8e8d20573a8210e13135f. Transitting job node result: incomplete -> fail 2026-05-04 18:49:45,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:45,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e8d20573a8210e13135f HTTP/1.1" 200 None 2026-05-04 18:49:45,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:45,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:49:45,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:45,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e8d20573a8210e13135f HTTP/1.1" 200 None 2026-05-04 18:49:45,770 - lava_callback - INFO - Completed processing callback for node 69f8e8d20573a8210e13135f INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54754 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:49:58,127 - lava_callback - INFO - Received callback for node 69f8e9140573a8210e131397 INFO: 172.20.0.1:54770 - "POST /node/69f8e9140573a8210e131397 HTTP/1.0" 202 Accepted 2026-05-04 18:49:58,134 - lava_callback - INFO - Starting async job submit for node 69f8e9140573a8210e131397 2026-05-04 18:49:58,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:58,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e9140573a8210e131397 HTTP/1.1" 200 None 2026-05-04 18:49:58,214 - lava_callback - DEBUG - Processing node 69f8e9140573a8210e131397: baseline-arm64 2026-05-04 18:49:58,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:58,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 18:49:58,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:49:58,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:49:58,702 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e9140573a8210e131397/log.txt.gz 2026-05-04 18:49:58,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:49:59,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:49:59,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e9140573a8210e131397/lava-logs.yaml 2026-05-04 18:49:59,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 18:49:59,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 18:49:59,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8e9140573a8210e131397/lava_callback.json.gz DEBUG: Setup failed for 69f8e9140573a8210e131397. Transitting job node result: incomplete -> fail 2026-05-04 18:49:59,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:59,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e9140573a8210e131397 HTTP/1.1" 200 None 2026-05-04 18:49:59,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:59,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 18:49:59,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:49:59,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e9140573a8210e131397 HTTP/1.1" 200 None 2026-05-04 18:49:59,422 - lava_callback - INFO - Completed processing callback for node 69f8e9140573a8210e131397 2026-05-04 18:50:06,309 - lava_callback - INFO - Received callback for node 69f6474c8234569b79a1f874 INFO: 172.20.0.1:57804 - "POST /node/69f6474c8234569b79a1f874 HTTP/1.0" 202 Accepted 2026-05-04 18:50:06,315 - lava_callback - INFO - Starting async job submit for node 69f6474c8234569b79a1f874 2026-05-04 18:50:06,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:06,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6474c8234569b79a1f874 HTTP/1.1" 200 None 2026-05-04 18:50:06,330 - lava_callback - DEBUG - Processing node 69f6474c8234569b79a1f874: baseline-arm-baylibre 2026-05-04 18:50:06,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6474c8234569b79a1f874 2026-05-04 18:50:06,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:06,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6474c8234569b79a1f874 HTTP/1.1" 200 None 2026-05-04 18:50:06,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:06,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:50:06,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:06,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6474c8234569b79a1f874 HTTP/1.1" 200 None 2026-05-04 18:50:06,387 - lava_callback - ERROR - Error processing callback for node 69f6474c8234569b79a1f874: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57890 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:50:28,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:28,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56510 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:50:49,613 - lava_callback - INFO - Received callback for node 69f6477e8234569b79a1f88b INFO: 172.20.0.1:56524 - "POST /node/69f6477e8234569b79a1f88b HTTP/1.0" 202 Accepted 2026-05-04 18:50:49,622 - lava_callback - INFO - Starting async job submit for node 69f6477e8234569b79a1f88b 2026-05-04 18:50:49,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:49,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6477e8234569b79a1f88b HTTP/1.1" 200 None 2026-05-04 18:50:49,645 - lava_callback - DEBUG - Processing node 69f6477e8234569b79a1f88b: baseline-arm64-clabbe 2026-05-04 18:50:49,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6477e8234569b79a1f88b 2026-05-04 18:50:49,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:49,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6477e8234569b79a1f88b HTTP/1.1" 200 None 2026-05-04 18:50:49,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:49,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:50:49,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:50:49,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6477e8234569b79a1f88b HTTP/1.1" 200 None 2026-05-04 18:50:49,691 - lava_callback - ERROR - Error processing callback for node 69f6477e8234569b79a1f88b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:51:49,742 - lava_callback - INFO - Received callback for node 69f647ba8234569b79a1f8ad INFO: 172.20.0.1:54954 - "POST /node/69f647ba8234569b79a1f8ad HTTP/1.0" 202 Accepted 2026-05-04 18:51:49,748 - lava_callback - INFO - Starting async job submit for node 69f647ba8234569b79a1f8ad 2026-05-04 18:51:49,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:51:49,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f647ba8234569b79a1f8ad HTTP/1.1" 200 None 2026-05-04 18:51:49,768 - lava_callback - DEBUG - Processing node 69f647ba8234569b79a1f8ad: baseline-arm-clabbe 2026-05-04 18:51:49,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f647ba8234569b79a1f8ad 2026-05-04 18:51:49,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:51:49,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f647ba8234569b79a1f8ad HTTP/1.1" 200 None 2026-05-04 18:51:49,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:51:49,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:51:49,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:51:49,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f647ba8234569b79a1f8ad HTTP/1.1" 200 None 2026-05-04 18:51:49,825 - lava_callback - ERROR - Error processing callback for node 69f647ba8234569b79a1f8ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46224 - "GET /node/698684492de8e2dea3665609%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46228 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:53:49,741 - lava_callback - INFO - Received callback for node 69f648298234569b79a1f8da INFO: 172.20.0.1:45094 - "POST /node/69f648298234569b79a1f8da HTTP/1.0" 202 Accepted 2026-05-04 18:53:49,746 - lava_callback - INFO - Starting async job submit for node 69f648298234569b79a1f8da 2026-05-04 18:53:49,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:53:49,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648298234569b79a1f8da HTTP/1.1" 200 None 2026-05-04 18:53:49,761 - lava_callback - DEBUG - Processing node 69f648298234569b79a1f8da: baseline-arm-clabbe 2026-05-04 18:53:49,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f648298234569b79a1f8da 2026-05-04 18:53:49,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:53:49,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648298234569b79a1f8da HTTP/1.1" 200 None 2026-05-04 18:53:49,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:53:49,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:53:49,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:53:49,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f648298234569b79a1f8da HTTP/1.1" 200 None 2026-05-04 18:53:49,818 - lava_callback - ERROR - Error processing callback for node 69f648298234569b79a1f8da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35376 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:54:29,708 - lava_callback - INFO - Received callback for node 69f648598234569b79a1f8ea INFO: 172.20.0.1:40714 - "POST /node/69f648598234569b79a1f8ea HTTP/1.0" 202 Accepted 2026-05-04 18:54:29,714 - lava_callback - INFO - Starting async job submit for node 69f648598234569b79a1f8ea 2026-05-04 18:54:29,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:54:29,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648598234569b79a1f8ea HTTP/1.1" 200 None 2026-05-04 18:54:29,730 - lava_callback - DEBUG - Processing node 69f648598234569b79a1f8ea: baseline-arm64-clabbe 2026-05-04 18:54:29,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f648598234569b79a1f8ea 2026-05-04 18:54:29,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:54:29,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648598234569b79a1f8ea HTTP/1.1" 200 None 2026-05-04 18:54:29,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:54:29,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:54:29,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:54:29,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f648598234569b79a1f8ea HTTP/1.1" 200 None 2026-05-04 18:54:29,780 - lava_callback - ERROR - Error processing callback for node 69f648598234569b79a1f8ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54532 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:55:29,851 - lava_callback - INFO - Received callback for node 69f648958234569b79a1f90d INFO: 172.20.0.1:54918 - "POST /node/69f648958234569b79a1f90d HTTP/1.0" 202 Accepted 2026-05-04 18:55:29,859 - lava_callback - INFO - Starting async job submit for node 69f648958234569b79a1f90d 2026-05-04 18:55:29,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:55:29,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648958234569b79a1f90d HTTP/1.1" 200 None 2026-05-04 18:55:29,879 - lava_callback - DEBUG - Processing node 69f648958234569b79a1f90d: baseline-arm-clabbe 2026-05-04 18:55:29,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f648958234569b79a1f90d 2026-05-04 18:55:29,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:55:29,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648958234569b79a1f90d HTTP/1.1" 200 None 2026-05-04 18:55:29,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:55:29,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:55:29,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:55:29,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f648958234569b79a1f90d HTTP/1.1" 200 None 2026-05-04 18:55:29,931 - lava_callback - ERROR - Error processing callback for node 69f648958234569b79a1f90d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55764 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:56:09,943 - lava_callback - INFO - Received callback for node 69f648c68234569b79a1f927 INFO: 172.20.0.1:40750 - "POST /node/69f648c68234569b79a1f927 HTTP/1.0" 202 Accepted 2026-05-04 18:56:09,948 - lava_callback - INFO - Starting async job submit for node 69f648c68234569b79a1f927 2026-05-04 18:56:09,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:56:09,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648c68234569b79a1f927 HTTP/1.1" 200 None 2026-05-04 18:56:09,964 - lava_callback - DEBUG - Processing node 69f648c68234569b79a1f927: baseline-arm64-clabbe 2026-05-04 18:56:09,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f648c68234569b79a1f927 2026-05-04 18:56:09,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:56:09,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f648c68234569b79a1f927 HTTP/1.1" 200 None 2026-05-04 18:56:09,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:56:10,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:56:10,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:56:10,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f648c68234569b79a1f927 HTTP/1.1" 200 None 2026-05-04 18:56:10,025 - lava_callback - ERROR - Error processing callback for node 69f648c68234569b79a1f927: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58156 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:57:09,911 - lava_callback - INFO - Received callback for node 69f649018234569b79a1f946 INFO: 172.20.0.1:44654 - "POST /node/69f649018234569b79a1f946 HTTP/1.0" 202 Accepted 2026-05-04 18:57:09,917 - lava_callback - INFO - Starting async job submit for node 69f649018234569b79a1f946 2026-05-04 18:57:09,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:57:09,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f649018234569b79a1f946 HTTP/1.1" 200 None 2026-05-04 18:57:09,931 - lava_callback - DEBUG - Processing node 69f649018234569b79a1f946: baseline-arm-clabbe 2026-05-04 18:57:09,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f649018234569b79a1f946 2026-05-04 18:57:09,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:57:09,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f649018234569b79a1f946 HTTP/1.1" 200 None 2026-05-04 18:57:09,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:57:09,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:57:09,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:57:09,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f649018234569b79a1f946 HTTP/1.1" 200 None 2026-05-04 18:57:09,988 - lava_callback - ERROR - Error processing callback for node 69f649018234569b79a1f946: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56502 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.20.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34762 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:59:09,941 - lava_callback - INFO - Received callback for node 69f6496e8234569b79a1f971 INFO: 172.20.0.1:33176 - "POST /node/69f6496e8234569b79a1f971 HTTP/1.0" 202 Accepted 2026-05-04 18:59:09,946 - lava_callback - INFO - Starting async job submit for node 69f6496e8234569b79a1f971 2026-05-04 18:59:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:09,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6496e8234569b79a1f971 HTTP/1.1" 200 None 2026-05-04 18:59:09,966 - lava_callback - DEBUG - Processing node 69f6496e8234569b79a1f971: baseline-arm-clabbe 2026-05-04 18:59:09,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6496e8234569b79a1f971 2026-05-04 18:59:09,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:09,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6496e8234569b79a1f971 HTTP/1.1" 200 None 2026-05-04 18:59:09,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:09,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 18:59:09,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:10,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6496e8234569b79a1f971 HTTP/1.1" 200 None 2026-05-04 18:59:10,012 - lava_callback - ERROR - Error processing callback for node 69f6496e8234569b79a1f971: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52906 - "GET / HTTP/1.0" 200 OK 2026-05-04 18:59:49,907 - lava_callback - INFO - Received callback for node 69f6499f8234569b79a1f985 INFO: 172.20.0.1:56440 - "POST /node/69f6499f8234569b79a1f985 HTTP/1.0" 202 Accepted 2026-05-04 18:59:49,912 - lava_callback - INFO - Starting async job submit for node 69f6499f8234569b79a1f985 2026-05-04 18:59:49,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:49,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6499f8234569b79a1f985 HTTP/1.1" 200 None 2026-05-04 18:59:49,948 - lava_callback - DEBUG - Processing node 69f6499f8234569b79a1f985: baseline-arm64-clabbe 2026-05-04 18:59:49,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6499f8234569b79a1f985 2026-05-04 18:59:49,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:49,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6499f8234569b79a1f985 HTTP/1.1" 200 None 2026-05-04 18:59:49,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:49,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 18:59:50,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 18:59:50,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6499f8234569b79a1f985 HTTP/1.1" 200 None 2026-05-04 18:59:50,048 - lava_callback - ERROR - Error processing callback for node 69f6499f8234569b79a1f985: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:01:31,329 - lava_callback - INFO - Received callback for node 69f8d1e90573a8210e1300d4 INFO: 172.20.0.1:37432 - "POST /node/69f8d1e90573a8210e1300d4 HTTP/1.0" 202 Accepted 2026-05-04 19:01:31,335 - lava_callback - INFO - Starting async job submit for node 69f8d1e90573a8210e1300d4 2026-05-04 19:01:31,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:31,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e90573a8210e1300d4 HTTP/1.1" 200 None 2026-05-04 19:01:31,390 - lava_callback - DEBUG - Processing node 69f8d1e90573a8210e1300d4: baseline-arm64-broonie 2026-05-04 19:01:31,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:01:31,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:01:31,761 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e90573a8210e1300d4/log.txt.gz 2026-05-04 19:01:31,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:01:32,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:01:32,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e90573a8210e1300d4/lava-logs.yaml 2026-05-04 19:01:32,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:01:32,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:01:32,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e90573a8210e1300d4/lava_callback.json.gz 2026-05-04 19:01:32,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:32,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e90573a8210e1300d4 HTTP/1.1" 200 None 2026-05-04 19:01:32,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:32,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 19:01:32,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:32,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1e90573a8210e1300d4 HTTP/1.1" 200 None 2026-05-04 19:01:32,432 - lava_callback - INFO - Completed processing callback for node 69f8d1e90573a8210e1300d4 INFO: 172.20.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:01:49,449 - lava_callback - INFO - Received callback for node 69f8e86f0573a8210e131303 INFO: 172.20.0.1:43332 - "POST /node/69f8e86f0573a8210e131303 HTTP/1.0" 202 Accepted 2026-05-04 19:01:49,457 - lava_callback - INFO - Starting async job submit for node 69f8e86f0573a8210e131303 2026-05-04 19:01:49,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:49,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e86f0573a8210e131303 HTTP/1.1" 200 None 2026-05-04 19:01:49,514 - lava_callback - DEBUG - Processing node 69f8e86f0573a8210e131303: baseline-nfs-arm64 2026-05-04 19:01:50,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:01:50,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:01:50,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e86f0573a8210e131303/log.txt.gz 2026-05-04 19:01:51,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:01:51,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:01:51,773 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e86f0573a8210e131303/lava-logs.yaml 2026-05-04 19:01:51,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:01:52,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:01:52,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8e86f0573a8210e131303/lava_callback.json.gz DEBUG: Setup failed for 69f8e86f0573a8210e131303. Transitting job node result: incomplete -> fail 2026-05-04 19:01:52,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8e86f0573a8210e131303 HTTP/1.1" 200 None 2026-05-04 19:01:52,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:52,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 19:01:52,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:52,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8e86f0573a8210e131303 HTTP/1.1" 200 None 2026-05-04 19:01:52,249 - lava_callback - INFO - Completed processing callback for node 69f8e86f0573a8210e131303 INFO: 172.20.0.1:43900 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:01:58,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:01:58,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52852 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:02:50,055 - lava_callback - INFO - Received callback for node 69f64a568234569b79a1f9eb INFO: 172.20.0.1:51688 - "POST /node/69f64a568234569b79a1f9eb HTTP/1.0" 202 Accepted 2026-05-04 19:02:50,061 - lava_callback - INFO - Starting async job submit for node 69f64a568234569b79a1f9eb 2026-05-04 19:02:50,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:02:50,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64a568234569b79a1f9eb HTTP/1.1" 200 None 2026-05-04 19:02:50,078 - lava_callback - DEBUG - Processing node 69f64a568234569b79a1f9eb: baseline-arm64-clabbe 2026-05-04 19:02:50,078 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64a568234569b79a1f9eb 2026-05-04 19:02:50,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:02:50,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64a568234569b79a1f9eb HTTP/1.1" 200 None 2026-05-04 19:02:50,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:02:50,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 19:02:50,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:02:50,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64a568234569b79a1f9eb HTTP/1.1" 200 None 2026-05-04 19:02:50,137 - lava_callback - ERROR - Error processing callback for node 69f64a568234569b79a1f9eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57128 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:04:27,194 - lava_callback - INFO - Received callback for node 69f64ab38234569b79a1fa1e INFO: 172.20.0.1:57134 - "POST /node/69f64ab38234569b79a1fa1e HTTP/1.0" 202 Accepted 2026-05-04 19:04:27,200 - lava_callback - INFO - Starting async job submit for node 69f64ab38234569b79a1fa1e 2026-05-04 19:04:27,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:04:27,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64ab38234569b79a1fa1e HTTP/1.1" 200 None 2026-05-04 19:04:27,223 - lava_callback - DEBUG - Processing node 69f64ab38234569b79a1fa1e: baseline-arm-baylibre 2026-05-04 19:04:27,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64ab38234569b79a1fa1e 2026-05-04 19:04:27,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:04:27,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64ab38234569b79a1fa1e HTTP/1.1" 200 None 2026-05-04 19:04:27,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:04:27,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:04:27,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:04:27,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64ab38234569b79a1fa1e HTTP/1.1" 200 None 2026-05-04 19:04:27,269 - lava_callback - ERROR - Error processing callback for node 69f64ab38234569b79a1fa1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:05:07,109 - lava_callback - INFO - Received callback for node 69f64ad78234569b79a1fa2c INFO: 172.20.0.1:39062 - "POST /node/69f64ad78234569b79a1fa2c HTTP/1.0" 202 Accepted 2026-05-04 19:05:07,118 - lava_callback - INFO - Starting async job submit for node 69f64ad78234569b79a1fa2c 2026-05-04 19:05:07,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:05:07,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64ad78234569b79a1fa2c HTTP/1.1" 200 None 2026-05-04 19:05:07,141 - lava_callback - DEBUG - Processing node 69f64ad78234569b79a1fa2c: baseline-arm-baylibre 2026-05-04 19:05:07,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64ad78234569b79a1fa2c 2026-05-04 19:05:07,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:05:07,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64ad78234569b79a1fa2c HTTP/1.1" 200 None 2026-05-04 19:05:07,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:05:07,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:05:07,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:05:07,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64ad78234569b79a1fa2c HTTP/1.1" 200 None 2026-05-04 19:05:07,188 - lava_callback - ERROR - Error processing callback for node 69f64ad78234569b79a1fa2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:06:10,153 - lava_callback - INFO - Received callback for node 69f64b0c8234569b79a1fa43 INFO: 172.20.0.1:46314 - "POST /node/69f64b0c8234569b79a1fa43 HTTP/1.0" 202 Accepted 2026-05-04 19:06:10,162 - lava_callback - INFO - Starting async job submit for node 69f64b0c8234569b79a1fa43 2026-05-04 19:06:10,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:10,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64b0c8234569b79a1fa43 HTTP/1.1" 200 None 2026-05-04 19:06:10,188 - lava_callback - DEBUG - Processing node 69f64b0c8234569b79a1fa43: baseline-arm64-clabbe 2026-05-04 19:06:10,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64b0c8234569b79a1fa43 2026-05-04 19:06:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:10,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64b0c8234569b79a1fa43 HTTP/1.1" 200 None 2026-05-04 19:06:10,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:10,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343cee61e72f6b29d1b22 HTTP/1.1" 200 None 2026-05-04 19:06:10,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:10,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64b0c8234569b79a1fa43 HTTP/1.1" 200 None 2026-05-04 19:06:10,242 - lava_callback - ERROR - Error processing callback for node 69f64b0c8234569b79a1fa43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51172 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:06:47,216 - lava_callback - INFO - Received callback for node 69f64b458234569b79a1fa61 INFO: 172.20.0.1:51182 - "POST /node/69f64b458234569b79a1fa61 HTTP/1.0" 202 Accepted 2026-05-04 19:06:47,222 - lava_callback - INFO - Starting async job submit for node 69f64b458234569b79a1fa61 2026-05-04 19:06:47,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:47,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64b458234569b79a1fa61 HTTP/1.1" 200 None 2026-05-04 19:06:47,237 - lava_callback - DEBUG - Processing node 69f64b458234569b79a1fa61: baseline-arm-baylibre 2026-05-04 19:06:47,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64b458234569b79a1fa61 2026-05-04 19:06:47,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:47,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64b458234569b79a1fa61 HTTP/1.1" 200 None 2026-05-04 19:06:47,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:47,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:06:47,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:06:47,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64b458234569b79a1fa61 HTTP/1.1" 200 None 2026-05-04 19:06:47,289 - lava_callback - ERROR - Error processing callback for node 69f64b458234569b79a1fa61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53642 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:07:27,183 - lava_callback - INFO - Received callback for node 69f64b688234569b79a1fa73 INFO: 172.20.0.1:53656 - "POST /node/69f64b688234569b79a1fa73 HTTP/1.0" 202 Accepted 2026-05-04 19:07:27,188 - lava_callback - INFO - Starting async job submit for node 69f64b688234569b79a1fa73 2026-05-04 19:07:27,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:07:27,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64b688234569b79a1fa73 HTTP/1.1" 200 None 2026-05-04 19:07:27,210 - lava_callback - DEBUG - Processing node 69f64b688234569b79a1fa73: baseline-arm-baylibre 2026-05-04 19:07:27,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64b688234569b79a1fa73 2026-05-04 19:07:27,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:07:27,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64b688234569b79a1fa73 HTTP/1.1" 200 None 2026-05-04 19:07:27,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:07:27,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:07:27,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:07:27,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64b688234569b79a1fa73 HTTP/1.1" 200 None 2026-05-04 19:07:27,255 - lava_callback - ERROR - Error processing callback for node 69f64b688234569b79a1fa73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59402 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:09:30,331 - lava_callback - INFO - Received callback for node 69f64bd48234569b79a1fa9a INFO: 172.20.0.1:55726 - "POST /node/69f64bd48234569b79a1fa9a HTTP/1.0" 202 Accepted 2026-05-04 19:09:30,337 - lava_callback - INFO - Starting async job submit for node 69f64bd48234569b79a1fa9a 2026-05-04 19:09:30,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:09:30,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64bd48234569b79a1fa9a HTTP/1.1" 200 None 2026-05-04 19:09:30,352 - lava_callback - DEBUG - Processing node 69f64bd48234569b79a1fa9a: baseline-arm-clabbe 2026-05-04 19:09:30,353 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64bd48234569b79a1fa9a 2026-05-04 19:09:30,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:09:30,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64bd48234569b79a1fa9a HTTP/1.1" 200 None 2026-05-04 19:09:30,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:09:30,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:09:30,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:09:30,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64bd48234569b79a1fa9a HTTP/1.1" 200 None 2026-05-04 19:09:30,408 - lava_callback - ERROR - Error processing callback for node 69f64bd48234569b79a1fa9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38228 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:10:42,302 - lava_callback - INFO - Received callback for node 69f8eb660573a8210e1314e6 INFO: 172.20.0.1:60412 - "POST /node/69f8eb660573a8210e1314e6 HTTP/1.0" 202 Accepted 2026-05-04 19:10:42,308 - lava_callback - INFO - Starting async job submit for node 69f8eb660573a8210e1314e6 2026-05-04 19:10:42,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:10:42,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb660573a8210e1314e6 HTTP/1.1" 200 None 2026-05-04 19:10:42,383 - lava_callback - DEBUG - Processing node 69f8eb660573a8210e1314e6: baseline-arm 2026-05-04 19:10:42,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:10:43,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:10:43,092 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69f8eb660573a8210e1314e6/log.txt.gz 2026-05-04 19:10:43,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:10:43,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:10:43,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69f8eb660573a8210e1314e6/lava-logs.yaml 2026-05-04 19:10:43,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60420 - "GET /node/69f3a18d2fa6ff8e8ca91585%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-04 19:10:43,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:10:43,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69f8eb660573a8210e1314e6/lava_callback.json.gz DEBUG: Setup failed for 69f8eb660573a8210e1314e6. Transitting job node result: incomplete -> fail 2026-05-04 19:10:43,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:10:43,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb660573a8210e1314e6 HTTP/1.1" 200 None 2026-05-04 19:10:43,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:10:44,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6650573a8210e12ccc1 HTTP/1.1" 200 None 2026-05-04 19:10:44,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:10:44,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8eb660573a8210e1314e6 HTTP/1.1" 200 None 2026-05-04 19:10:44,152 - lava_callback - INFO - Completed processing callback for node 69f8eb660573a8210e1314e6 INFO: 172.20.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33838 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:10:58,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:10:58,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35278 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:11:10,431 - lava_callback - INFO - Received callback for node 69f64c448234569b79a1fabc INFO: 172.20.0.1:59434 - "POST /node/69f64c448234569b79a1fabc HTTP/1.0" 202 Accepted 2026-05-04 19:11:10,437 - lava_callback - INFO - Starting async job submit for node 69f64c448234569b79a1fabc 2026-05-04 19:11:10,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:10,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64c448234569b79a1fabc HTTP/1.1" 200 None 2026-05-04 19:11:10,452 - lava_callback - DEBUG - Processing node 69f64c448234569b79a1fabc: baseline-arm-clabbe 2026-05-04 19:11:10,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64c448234569b79a1fabc 2026-05-04 19:11:10,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:10,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64c448234569b79a1fabc HTTP/1.1" 200 None 2026-05-04 19:11:10,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:10,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:11:10,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:10,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64c448234569b79a1fabc HTTP/1.1" 200 None 2026-05-04 19:11:10,498 - lava_callback - ERROR - Error processing callback for node 69f64c448234569b79a1fabc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57576 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:11:50,373 - lava_callback - INFO - Received callback for node 69f64c688234569b79a1facc INFO: 172.20.0.1:37090 - "POST /node/69f64c688234569b79a1facc HTTP/1.0" 202 Accepted 2026-05-04 19:11:50,380 - lava_callback - INFO - Starting async job submit for node 69f64c688234569b79a1facc 2026-05-04 19:11:50,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:50,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64c688234569b79a1facc HTTP/1.1" 200 None 2026-05-04 19:11:50,396 - lava_callback - DEBUG - Processing node 69f64c688234569b79a1facc: baseline-arm-clabbe 2026-05-04 19:11:50,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64c688234569b79a1facc 2026-05-04 19:11:50,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:50,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64c688234569b79a1facc HTTP/1.1" 200 None 2026-05-04 19:11:50,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:50,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:11:50,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:11:50,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64c688234569b79a1facc HTTP/1.1" 200 None 2026-05-04 19:11:50,446 - lava_callback - ERROR - Error processing callback for node 69f64c688234569b79a1facc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41216 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:12:13,526 - lava_callback - INFO - Received callback for node 69f8eb640573a8210e1314e1 INFO: 172.20.0.1:45072 - "POST /node/69f8eb640573a8210e1314e1 HTTP/1.0" 202 Accepted 2026-05-04 19:12:13,536 - lava_callback - INFO - Starting async job submit for node 69f8eb640573a8210e1314e1 2026-05-04 19:12:13,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:13,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb640573a8210e1314e1 HTTP/1.1" 200 None 2026-05-04 19:12:13,632 - lava_callback - DEBUG - Processing node 69f8eb640573a8210e1314e1: ltp-smoke 2026-05-04 19:12:14,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:12:14,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:12:14,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8eb640573a8210e1314e1/log.txt.gz 2026-05-04 19:12:14,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:12:14,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:12:14,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8eb640573a8210e1314e1/lava-logs.yaml 2026-05-04 19:12:14,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:12:14,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:12:14,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69f8eb640573a8210e1314e1/lava_callback.json.gz 2026-05-04 19:12:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:15,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8eb640573a8210e1314e1 HTTP/1.1" 200 None 2026-05-04 19:12:15,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:15,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c66b0573a8210e12ccc7 HTTP/1.1" 200 None 2026-05-04 19:12:15,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:15,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8eb640573a8210e1314e1 HTTP/1.1" 200 None 2026-05-04 19:12:15,148 - lava_callback - INFO - Completed processing callback for node 69f8eb640573a8210e1314e1 INFO: 172.20.0.1:45076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46776 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:12:28,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:28,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-04 19:12:30,442 - lava_callback - INFO - Received callback for node 69f64c8c8234569b79a1fad8 INFO: 172.20.0.1:53008 - "POST /node/69f64c8c8234569b79a1fad8 HTTP/1.0" 202 Accepted 2026-05-04 19:12:30,448 - lava_callback - INFO - Starting async job submit for node 69f64c8c8234569b79a1fad8 2026-05-04 19:12:30,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:30,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64c8c8234569b79a1fad8 HTTP/1.1" 200 None 2026-05-04 19:12:30,463 - lava_callback - DEBUG - Processing node 69f64c8c8234569b79a1fad8: baseline-arm-clabbe 2026-05-04 19:12:30,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64c8c8234569b79a1fad8 2026-05-04 19:12:30,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:30,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64c8c8234569b79a1fad8 HTTP/1.1" 200 None 2026-05-04 19:12:30,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:30,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:12:30,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:12:30,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64c8c8234569b79a1fad8 HTTP/1.1" 200 None 2026-05-04 19:12:30,515 - lava_callback - ERROR - Error processing callback for node 69f64c8c8234569b79a1fad8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33802 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:14:10,522 - lava_callback - INFO - Received callback for node 69f64cfa8234569b79a1fafd INFO: 172.20.0.1:56542 - "POST /node/69f64cfa8234569b79a1fafd HTTP/1.0" 202 Accepted 2026-05-04 19:14:10,528 - lava_callback - INFO - Starting async job submit for node 69f64cfa8234569b79a1fafd 2026-05-04 19:14:10,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:14:10,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64cfa8234569b79a1fafd HTTP/1.1" 200 None 2026-05-04 19:14:10,543 - lava_callback - DEBUG - Processing node 69f64cfa8234569b79a1fafd: baseline-arm-clabbe 2026-05-04 19:14:10,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64cfa8234569b79a1fafd 2026-05-04 19:14:10,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:14:10,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64cfa8234569b79a1fafd HTTP/1.1" 200 None 2026-05-04 19:14:10,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:14:10,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-04 19:14:10,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:14:10,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64cfa8234569b79a1fafd HTTP/1.1" 200 None 2026-05-04 19:14:10,616 - lava_callback - ERROR - Error processing callback for node 69f64cfa8234569b79a1fafd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:15:50,545 - lava_callback - INFO - Received callback for node 69f64d5a8234569b79a1fb16 INFO: 172.20.0.1:51926 - "POST /node/69f64d5a8234569b79a1fb16 HTTP/1.0" 202 Accepted 2026-05-04 19:15:50,551 - lava_callback - INFO - Starting async job submit for node 69f64d5a8234569b79a1fb16 2026-05-04 19:15:50,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:15:50,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64d5a8234569b79a1fb16 HTTP/1.1" 200 None 2026-05-04 19:15:50,567 - lava_callback - DEBUG - Processing node 69f64d5a8234569b79a1fb16: baseline-arm-clabbe 2026-05-04 19:15:50,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64d5a8234569b79a1fb16 2026-05-04 19:15:50,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:15:50,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64d5a8234569b79a1fb16 HTTP/1.1" 200 None 2026-05-04 19:15:50,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:15:50,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 19:15:50,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:15:50,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64d5a8234569b79a1fb16 HTTP/1.1" 200 None 2026-05-04 19:15:50,611 - lava_callback - ERROR - Error processing callback for node 69f64d5a8234569b79a1fb16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44978 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:20:10,683 - lava_callback - INFO - Received callback for node 69f64e588234569b79a1fb90 INFO: 172.20.0.1:47908 - "POST /node/69f64e588234569b79a1fb90 HTTP/1.0" 202 Accepted 2026-05-04 19:20:10,688 - lava_callback - INFO - Starting async job submit for node 69f64e588234569b79a1fb90 2026-05-04 19:20:10,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:20:10,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64e588234569b79a1fb90 HTTP/1.1" 200 None 2026-05-04 19:20:10,706 - lava_callback - DEBUG - Processing node 69f64e588234569b79a1fb90: baseline-arm-clabbe 2026-05-04 19:20:10,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64e588234569b79a1fb90 2026-05-04 19:20:10,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:20:10,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64e588234569b79a1fb90 HTTP/1.1" 200 None 2026-05-04 19:20:10,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:20:10,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 19:20:10,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:20:10,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64e588234569b79a1fb90 HTTP/1.1" 200 None 2026-05-04 19:20:10,771 - lava_callback - ERROR - Error processing callback for node 69f64e588234569b79a1fb90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42824 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:21:50,776 - lava_callback - INFO - Received callback for node 69f64ec58234569b79a1fbce INFO: 172.20.0.1:35258 - "POST /node/69f64ec58234569b79a1fbce HTTP/1.0" 202 Accepted 2026-05-04 19:21:50,782 - lava_callback - INFO - Starting async job submit for node 69f64ec58234569b79a1fbce 2026-05-04 19:21:50,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:21:50,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64ec58234569b79a1fbce HTTP/1.1" 200 None 2026-05-04 19:21:50,800 - lava_callback - DEBUG - Processing node 69f64ec58234569b79a1fbce: baseline-arm-clabbe 2026-05-04 19:21:50,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64ec58234569b79a1fbce 2026-05-04 19:21:50,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:21:50,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64ec58234569b79a1fbce HTTP/1.1" 200 None 2026-05-04 19:21:50,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:21:50,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 19:21:50,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:21:50,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64ec58234569b79a1fbce HTTP/1.1" 200 None 2026-05-04 19:21:50,857 - lava_callback - ERROR - Error processing callback for node 69f64ec58234569b79a1fbce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34290 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:22:30,852 - lava_callback - INFO - Received callback for node 69f64eea8234569b79a1fbdb INFO: 172.20.0.1:44974 - "POST /node/69f64eea8234569b79a1fbdb HTTP/1.0" 202 Accepted 2026-05-04 19:22:30,857 - lava_callback - INFO - Starting async job submit for node 69f64eea8234569b79a1fbdb 2026-05-04 19:22:30,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:22:30,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64eea8234569b79a1fbdb HTTP/1.1" 200 None 2026-05-04 19:22:30,873 - lava_callback - DEBUG - Processing node 69f64eea8234569b79a1fbdb: baseline-arm-clabbe 2026-05-04 19:22:30,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64eea8234569b79a1fbdb 2026-05-04 19:22:30,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:22:30,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64eea8234569b79a1fbdb HTTP/1.1" 200 None 2026-05-04 19:22:30,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:22:30,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 19:22:30,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:22:30,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64eea8234569b79a1fbdb HTTP/1.1" 200 None 2026-05-04 19:22:30,920 - lava_callback - ERROR - Error processing callback for node 69f64eea8234569b79a1fbdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:25:30,945 - lava_callback - INFO - Received callback for node 69f64fa38234569b79a1fc36 INFO: 172.20.0.1:37082 - "POST /node/69f64fa38234569b79a1fc36 HTTP/1.0" 202 Accepted 2026-05-04 19:25:30,950 - lava_callback - INFO - Starting async job submit for node 69f64fa38234569b79a1fc36 2026-05-04 19:25:30,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:25:30,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64fa38234569b79a1fc36 HTTP/1.1" 200 None 2026-05-04 19:25:30,965 - lava_callback - DEBUG - Processing node 69f64fa38234569b79a1fc36: baseline-arm-clabbe 2026-05-04 19:25:30,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64fa38234569b79a1fc36 2026-05-04 19:25:30,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:25:30,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64fa38234569b79a1fc36 HTTP/1.1" 200 None 2026-05-04 19:25:30,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:25:30,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f343b9e61e72f6b29d1b08 HTTP/1.1" 200 None 2026-05-04 19:25:30,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:25:31,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64fa38234569b79a1fc36 HTTP/1.1" 200 None 2026-05-04 19:25:31,031 - lava_callback - ERROR - Error processing callback for node 69f64fa38234569b79a1fc36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:26:08,313 - lava_callback - INFO - Received callback for node 69f64fcc8234569b79a1fc46 INFO: 172.20.0.1:47190 - "POST /node/69f64fcc8234569b79a1fc46 HTTP/1.0" 202 Accepted 2026-05-04 19:26:08,318 - lava_callback - INFO - Starting async job submit for node 69f64fcc8234569b79a1fc46 2026-05-04 19:26:08,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:08,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64fcc8234569b79a1fc46 HTTP/1.1" 200 None 2026-05-04 19:26:08,333 - lava_callback - DEBUG - Processing node 69f64fcc8234569b79a1fc46: baseline-arm64-baylibre 2026-05-04 19:26:08,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f64fcc8234569b79a1fc46 2026-05-04 19:26:08,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:08,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f64fcc8234569b79a1fc46 HTTP/1.1" 200 None 2026-05-04 19:26:08,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:08,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:26:08,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:08,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f64fcc8234569b79a1fc46 HTTP/1.1" 200 None 2026-05-04 19:26:08,386 - lava_callback - ERROR - Error processing callback for node 69f64fcc8234569b79a1fc46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40352 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:26:19,923 - lava_callback - INFO - Received callback for node 69f8d1ec0573a8210e1300d7 INFO: 172.20.0.1:34254 - "POST /node/69f8d1ec0573a8210e1300d7 HTTP/1.0" 202 Accepted 2026-05-04 19:26:19,929 - lava_callback - INFO - Starting async job submit for node 69f8d1ec0573a8210e1300d7 2026-05-04 19:26:19,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:19,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ec0573a8210e1300d7 HTTP/1.1" 200 None 2026-05-04 19:26:19,968 - lava_callback - DEBUG - Processing node 69f8d1ec0573a8210e1300d7: baseline-arm64-broonie 2026-05-04 19:26:20,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:26:20,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:26:20,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1ec0573a8210e1300d7/log.txt.gz 2026-05-04 19:26:20,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:26:20,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:26:20,960 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1ec0573a8210e1300d7/lava-logs.yaml 2026-05-04 19:26:20,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:26:21,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:26:21,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1ec0573a8210e1300d7/lava_callback.json.gz 2026-05-04 19:26:21,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:21,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1ec0573a8210e1300d7 HTTP/1.1" 200 None 2026-05-04 19:26:21,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:21,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 19:26:21,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:21,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1ec0573a8210e1300d7 HTTP/1.1" 200 None 2026-05-04 19:26:21,173 - lava_callback - INFO - Completed processing callback for node 69f8d1ec0573a8210e1300d7 INFO: 172.20.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34280 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:26:28,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:26:28,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40468 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:27:28,254 - lava_callback - INFO - Received callback for node 69f650158234569b79a1fc74 INFO: 172.20.0.1:40470 - "POST /node/69f650158234569b79a1fc74 HTTP/1.0" 202 Accepted 2026-05-04 19:27:28,260 - lava_callback - INFO - Starting async job submit for node 69f650158234569b79a1fc74 2026-05-04 19:27:28,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:27:28,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f650158234569b79a1fc74 HTTP/1.1" 200 None 2026-05-04 19:27:28,275 - lava_callback - DEBUG - Processing node 69f650158234569b79a1fc74: baseline-arm64-baylibre 2026-05-04 19:27:28,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f650158234569b79a1fc74 2026-05-04 19:27:28,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:27:28,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f650158234569b79a1fc74 HTTP/1.1" 200 None 2026-05-04 19:27:28,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:27:28,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:27:28,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:27:28,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f650158234569b79a1fc74 HTTP/1.1" 200 None 2026-05-04 19:27:28,329 - lava_callback - ERROR - Error processing callback for node 69f650158234569b79a1fc74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51710 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:28:48,333 - lava_callback - INFO - Received callback for node 69f6505e8234569b79a1fc9c INFO: 172.20.0.1:51716 - "POST /node/69f6505e8234569b79a1fc9c HTTP/1.0" 202 Accepted 2026-05-04 19:28:48,339 - lava_callback - INFO - Starting async job submit for node 69f6505e8234569b79a1fc9c 2026-05-04 19:28:48,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:28:48,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6505e8234569b79a1fc9c HTTP/1.1" 200 None 2026-05-04 19:28:48,375 - lava_callback - DEBUG - Processing node 69f6505e8234569b79a1fc9c: baseline-arm64-baylibre 2026-05-04 19:28:48,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6505e8234569b79a1fc9c 2026-05-04 19:28:48,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:28:48,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6505e8234569b79a1fc9c HTTP/1.1" 200 None 2026-05-04 19:28:48,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:28:48,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:28:48,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:28:48,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6505e8234569b79a1fc9c HTTP/1.1" 200 None 2026-05-04 19:28:48,458 - lava_callback - ERROR - Error processing callback for node 69f6505e8234569b79a1fc9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42800 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:29:48,338 - lava_callback - INFO - Received callback for node 69f650a88234569b79a1fccd INFO: 172.20.0.1:42808 - "POST /node/69f650a88234569b79a1fccd HTTP/1.0" 202 Accepted 2026-05-04 19:29:48,343 - lava_callback - INFO - Starting async job submit for node 69f650a88234569b79a1fccd 2026-05-04 19:29:48,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:29:48,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f650a88234569b79a1fccd HTTP/1.1" 200 None 2026-05-04 19:29:48,358 - lava_callback - DEBUG - Processing node 69f650a88234569b79a1fccd: baseline-arm64-baylibre 2026-05-04 19:29:48,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f650a88234569b79a1fccd 2026-05-04 19:29:48,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:29:48,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f650a88234569b79a1fccd HTTP/1.1" 200 None 2026-05-04 19:29:48,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:29:48,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:29:48,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:29:48,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f650a88234569b79a1fccd HTTP/1.1" 200 None 2026-05-04 19:29:48,419 - lava_callback - ERROR - Error processing callback for node 69f650a88234569b79a1fccd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:31:08,509 - lava_callback - INFO - Received callback for node 69f650f38234569b79a1fcef INFO: 172.20.0.1:60100 - "POST /node/69f650f38234569b79a1fcef HTTP/1.0" 202 Accepted 2026-05-04 19:31:08,514 - lava_callback - INFO - Starting async job submit for node 69f650f38234569b79a1fcef 2026-05-04 19:31:08,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:31:08,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f650f38234569b79a1fcef HTTP/1.1" 200 None 2026-05-04 19:31:08,529 - lava_callback - DEBUG - Processing node 69f650f38234569b79a1fcef: baseline-arm64-baylibre 2026-05-04 19:31:08,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f650f38234569b79a1fcef 2026-05-04 19:31:08,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:31:08,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f650f38234569b79a1fcef HTTP/1.1" 200 None 2026-05-04 19:31:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:31:08,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:31:08,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:31:08,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f650f38234569b79a1fcef HTTP/1.1" 200 None 2026-05-04 19:31:08,578 - lava_callback - ERROR - Error processing callback for node 69f650f38234569b79a1fcef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47858 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:32:28,587 - lava_callback - INFO - Received callback for node 69f6513c8234569b79a1fd21 INFO: 172.20.0.1:47866 - "POST /node/69f6513c8234569b79a1fd21 HTTP/1.0" 202 Accepted 2026-05-04 19:32:28,592 - lava_callback - INFO - Starting async job submit for node 69f6513c8234569b79a1fd21 2026-05-04 19:32:28,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:32:28,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6513c8234569b79a1fd21 HTTP/1.1" 200 None 2026-05-04 19:32:28,613 - lava_callback - DEBUG - Processing node 69f6513c8234569b79a1fd21: baseline-arm64-baylibre 2026-05-04 19:32:28,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6513c8234569b79a1fd21 2026-05-04 19:32:28,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:32:28,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6513c8234569b79a1fd21 HTTP/1.1" 200 None 2026-05-04 19:32:28,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:32:28,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:32:28,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:32:28,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6513c8234569b79a1fd21 HTTP/1.1" 200 None 2026-05-04 19:32:28,661 - lava_callback - ERROR - Error processing callback for node 69f6513c8234569b79a1fd21: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46936 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:33:51,337 - lava_callback - INFO - Received callback for node 69f6518a8234569b79a1fd43 INFO: 172.20.0.1:35256 - "POST /node/69f6518a8234569b79a1fd43 HTTP/1.0" 202 Accepted 2026-05-04 19:33:51,342 - lava_callback - INFO - Starting async job submit for node 69f6518a8234569b79a1fd43 2026-05-04 19:33:51,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:33:51,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6518a8234569b79a1fd43 HTTP/1.1" 200 None 2026-05-04 19:33:51,358 - lava_callback - DEBUG - Processing node 69f6518a8234569b79a1fd43: baseline-arm64-clabbe 2026-05-04 19:33:51,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6518a8234569b79a1fd43 2026-05-04 19:33:51,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:33:51,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6518a8234569b79a1fd43 HTTP/1.1" 200 None 2026-05-04 19:33:51,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:33:51,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:33:51,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:33:51,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6518a8234569b79a1fd43 HTTP/1.1" 200 None 2026-05-04 19:33:51,429 - lava_callback - ERROR - Error processing callback for node 69f6518a8234569b79a1fd43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44550 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:34:51,373 - lava_callback - INFO - Received callback for node 69f651d28234569b79a1fd75 INFO: 172.20.0.1:47182 - "POST /node/69f651d28234569b79a1fd75 HTTP/1.0" 202 Accepted 2026-05-04 19:34:51,379 - lava_callback - INFO - Starting async job submit for node 69f651d28234569b79a1fd75 2026-05-04 19:34:51,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:34:51,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f651d28234569b79a1fd75 HTTP/1.1" 200 None 2026-05-04 19:34:51,395 - lava_callback - DEBUG - Processing node 69f651d28234569b79a1fd75: baseline-arm64-clabbe 2026-05-04 19:34:51,395 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f651d28234569b79a1fd75 2026-05-04 19:34:51,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:34:51,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f651d28234569b79a1fd75 HTTP/1.1" 200 None 2026-05-04 19:34:51,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:34:51,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:34:51,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:34:51,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f651d28234569b79a1fd75 HTTP/1.1" 200 None 2026-05-04 19:34:51,441 - lava_callback - ERROR - Error processing callback for node 69f651d28234569b79a1fd75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58698 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:36:11,409 - lava_callback - INFO - Received callback for node 69f6521c8234569b79a1fd99 INFO: 172.20.0.1:46122 - "POST /node/69f6521c8234569b79a1fd99 HTTP/1.0" 202 Accepted 2026-05-04 19:36:11,415 - lava_callback - INFO - Starting async job submit for node 69f6521c8234569b79a1fd99 2026-05-04 19:36:11,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:36:11,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6521c8234569b79a1fd99 HTTP/1.1" 200 None 2026-05-04 19:36:11,431 - lava_callback - DEBUG - Processing node 69f6521c8234569b79a1fd99: baseline-arm64-clabbe 2026-05-04 19:36:11,431 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6521c8234569b79a1fd99 2026-05-04 19:36:11,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:36:11,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6521c8234569b79a1fd99 HTTP/1.1" 200 None 2026-05-04 19:36:11,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:36:11,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:36:11,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:36:11,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6521c8234569b79a1fd99 HTTP/1.1" 200 None 2026-05-04 19:36:11,477 - lava_callback - ERROR - Error processing callback for node 69f6521c8234569b79a1fd99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37518 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:37:08,839 - lava_callback - INFO - Received callback for node 69f652528234569b79a1fdbd INFO: 172.20.0.1:37520 - "POST /node/69f652528234569b79a1fdbd HTTP/1.0" 202 Accepted 2026-05-04 19:37:08,844 - lava_callback - INFO - Starting async job submit for node 69f652528234569b79a1fdbd 2026-05-04 19:37:08,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:08,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652528234569b79a1fdbd HTTP/1.1" 200 None 2026-05-04 19:37:08,859 - lava_callback - DEBUG - Processing node 69f652528234569b79a1fdbd: baseline-arm-baylibre 2026-05-04 19:37:08,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f652528234569b79a1fdbd 2026-05-04 19:37:08,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:08,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652528234569b79a1fdbd HTTP/1.1" 200 None 2026-05-04 19:37:08,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:08,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:37:08,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:08,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f652528234569b79a1fdbd HTTP/1.1" 200 None 2026-05-04 19:37:08,912 - lava_callback - ERROR - Error processing callback for node 69f652528234569b79a1fdbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38634 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:37:28,827 - lava_callback - INFO - Received callback for node 69f652768234569b79a1fdcf INFO: 172.20.0.1:38650 - "POST /node/69f652768234569b79a1fdcf HTTP/1.0" 202 Accepted 2026-05-04 19:37:28,833 - lava_callback - INFO - Starting async job submit for node 69f652768234569b79a1fdcf 2026-05-04 19:37:28,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:28,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652768234569b79a1fdcf HTTP/1.1" 200 None 2026-05-04 19:37:28,848 - lava_callback - DEBUG - Processing node 69f652768234569b79a1fdcf: baseline-arm-baylibre 2026-05-04 19:37:28,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f652768234569b79a1fdcf 2026-05-04 19:37:28,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:28,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652768234569b79a1fdcf HTTP/1.1" 200 None 2026-05-04 19:37:28,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:28,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:37:28,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:37:28,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f652768234569b79a1fdcf HTTP/1.1" 200 None 2026-05-04 19:37:28,901 - lava_callback - ERROR - Error processing callback for node 69f652768234569b79a1fdcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59880 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:38:31,520 - lava_callback - INFO - Received callback for node 69f652ac8234569b79a1fde4 INFO: 172.20.0.1:39980 - "POST /node/69f652ac8234569b79a1fde4 HTTP/1.0" 202 Accepted 2026-05-04 19:38:31,525 - lava_callback - INFO - Starting async job submit for node 69f652ac8234569b79a1fde4 2026-05-04 19:38:31,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:38:31,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652ac8234569b79a1fde4 HTTP/1.1" 200 None 2026-05-04 19:38:31,541 - lava_callback - DEBUG - Processing node 69f652ac8234569b79a1fde4: baseline-arm64-clabbe 2026-05-04 19:38:31,541 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f652ac8234569b79a1fde4 2026-05-04 19:38:31,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:38:31,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652ac8234569b79a1fde4 HTTP/1.1" 200 None 2026-05-04 19:38:31,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:38:31,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:38:31,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:38:31,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f652ac8234569b79a1fde4 HTTP/1.1" 200 None 2026-05-04 19:38:31,588 - lava_callback - ERROR - Error processing callback for node 69f652ac8234569b79a1fde4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56640 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:39:29,004 - lava_callback - INFO - Received callback for node 69f652e48234569b79a1fe03 INFO: 172.20.0.1:56654 - "POST /node/69f652e48234569b79a1fe03 HTTP/1.0" 202 Accepted 2026-05-04 19:39:29,009 - lava_callback - INFO - Starting async job submit for node 69f652e48234569b79a1fe03 2026-05-04 19:39:29,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:39:29,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652e48234569b79a1fe03 HTTP/1.1" 200 None 2026-05-04 19:39:29,025 - lava_callback - DEBUG - Processing node 69f652e48234569b79a1fe03: baseline-arm-baylibre 2026-05-04 19:39:29,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f652e48234569b79a1fe03 2026-05-04 19:39:29,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:39:29,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f652e48234569b79a1fe03 HTTP/1.1" 200 None 2026-05-04 19:39:29,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:39:29,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:39:29,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:39:29,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f652e48234569b79a1fe03 HTTP/1.1" 200 None 2026-05-04 19:39:29,077 - lava_callback - ERROR - Error processing callback for node 69f652e48234569b79a1fe03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53458 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:40:08,988 - lava_callback - INFO - Received callback for node 69f653088234569b79a1fe11 INFO: 172.20.0.1:53460 - "POST /node/69f653088234569b79a1fe11 HTTP/1.0" 202 Accepted 2026-05-04 19:40:08,994 - lava_callback - INFO - Starting async job submit for node 69f653088234569b79a1fe11 2026-05-04 19:40:08,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:09,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f653088234569b79a1fe11 HTTP/1.1" 200 None 2026-05-04 19:40:09,013 - lava_callback - DEBUG - Processing node 69f653088234569b79a1fe11: baseline-arm-baylibre 2026-05-04 19:40:09,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f653088234569b79a1fe11 2026-05-04 19:40:09,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:09,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f653088234569b79a1fe11 HTTP/1.1" 200 None 2026-05-04 19:40:09,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:09,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:40:09,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:09,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f653088234569b79a1fe11 HTTP/1.1" 200 None 2026-05-04 19:40:09,069 - lava_callback - ERROR - Error processing callback for node 69f653088234569b79a1fe11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:40:49,117 - lava_callback - INFO - Received callback for node 69f6532c8234569b79a1fe1f INFO: 172.20.0.1:41848 - "POST /node/69f6532c8234569b79a1fe1f HTTP/1.0" 202 Accepted 2026-05-04 19:40:49,123 - lava_callback - INFO - Starting async job submit for node 69f6532c8234569b79a1fe1f 2026-05-04 19:40:49,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:49,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6532c8234569b79a1fe1f HTTP/1.1" 200 None 2026-05-04 19:40:49,138 - lava_callback - DEBUG - Processing node 69f6532c8234569b79a1fe1f: baseline-arm-baylibre 2026-05-04 19:40:49,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6532c8234569b79a1fe1f 2026-05-04 19:40:49,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:49,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6532c8234569b79a1fe1f HTTP/1.1" 200 None 2026-05-04 19:40:49,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:49,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:40:49,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:40:49,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6532c8234569b79a1fe1f HTTP/1.1" 200 None 2026-05-04 19:40:49,184 - lava_callback - ERROR - Error processing callback for node 69f6532c8234569b79a1fe1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35620 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:41:00,433 - lava_callback - INFO - Received callback for node 69f8d1e60573a8210e1300c9 INFO: 172.20.0.1:45002 - "POST /node/69f8d1e60573a8210e1300c9 HTTP/1.0" 202 Accepted 2026-05-04 19:41:00,439 - lava_callback - INFO - Starting async job submit for node 69f8d1e60573a8210e1300c9 2026-05-04 19:41:00,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:41:00,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e60573a8210e1300c9 HTTP/1.1" 200 None 2026-05-04 19:41:00,476 - lava_callback - DEBUG - Processing node 69f8d1e60573a8210e1300c9: baseline-arm64-broonie 2026-05-04 19:41:00,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:41:01,021 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:41:01,023 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e60573a8210e1300c9/log.txt.gz 2026-05-04 19:41:01,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:41:01,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:41:01,348 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e60573a8210e1300c9/lava-logs.yaml 2026-05-04 19:41:01,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 19:41:01,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 19:41:01,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69f8d1e60573a8210e1300c9/lava_callback.json.gz 2026-05-04 19:41:01,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:41:01,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8d1e60573a8210e1300c9 HTTP/1.1" 200 None 2026-05-04 19:41:01,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:41:01,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 19:41:01,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:41:01,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8d1e60573a8210e1300c9 HTTP/1.1" 200 None 2026-05-04 19:41:01,558 - lava_callback - INFO - Completed processing callback for node 69f8d1e60573a8210e1300c9 INFO: 172.20.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49038 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:41:28,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:41:28,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37742 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:42:29,128 - lava_callback - INFO - Received callback for node 69f653988234569b79a1fe53 INFO: 172.20.0.1:37756 - "POST /node/69f653988234569b79a1fe53 HTTP/1.0" 202 Accepted 2026-05-04 19:42:29,134 - lava_callback - INFO - Starting async job submit for node 69f653988234569b79a1fe53 2026-05-04 19:42:29,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:42:29,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f653988234569b79a1fe53 HTTP/1.1" 200 None 2026-05-04 19:42:29,149 - lava_callback - DEBUG - Processing node 69f653988234569b79a1fe53: baseline-arm-baylibre 2026-05-04 19:42:29,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f653988234569b79a1fe53 2026-05-04 19:42:29,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:42:29,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f653988234569b79a1fe53 HTTP/1.1" 200 None 2026-05-04 19:42:29,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:42:29,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:42:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:42:29,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f653988234569b79a1fe53 HTTP/1.1" 200 None 2026-05-04 19:42:29,204 - lava_callback - ERROR - Error processing callback for node 69f653988234569b79a1fe53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60878 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:43:11,753 - lava_callback - INFO - Received callback for node 69f653cb8234569b79a1fe6d INFO: 172.20.0.1:55746 - "POST /node/69f653cb8234569b79a1fe6d HTTP/1.0" 202 Accepted 2026-05-04 19:43:11,758 - lava_callback - INFO - Starting async job submit for node 69f653cb8234569b79a1fe6d 2026-05-04 19:43:11,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:43:11,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f653cb8234569b79a1fe6d HTTP/1.1" 200 None 2026-05-04 19:43:11,774 - lava_callback - DEBUG - Processing node 69f653cb8234569b79a1fe6d: baseline-arm64-clabbe 2026-05-04 19:43:11,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f653cb8234569b79a1fe6d 2026-05-04 19:43:11,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:43:11,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f653cb8234569b79a1fe6d HTTP/1.1" 200 None 2026-05-04 19:43:11,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:43:11,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:43:11,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:43:11,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f653cb8234569b79a1fe6d HTTP/1.1" 200 None 2026-05-04 19:43:11,823 - lava_callback - ERROR - Error processing callback for node 69f653cb8234569b79a1fe6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48000 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:44:11,726 - lava_callback - INFO - Received callback for node 69f654058234569b79a1fe85 INFO: 172.20.0.1:55770 - "POST /node/69f654058234569b79a1fe85 HTTP/1.0" 202 Accepted 2026-05-04 19:44:11,732 - lava_callback - INFO - Starting async job submit for node 69f654058234569b79a1fe85 2026-05-04 19:44:11,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:11,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654058234569b79a1fe85 HTTP/1.1" 200 None 2026-05-04 19:44:11,759 - lava_callback - DEBUG - Processing node 69f654058234569b79a1fe85: baseline-arm-clabbe 2026-05-04 19:44:11,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f654058234569b79a1fe85 2026-05-04 19:44:11,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:11,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654058234569b79a1fe85 HTTP/1.1" 200 None 2026-05-04 19:44:11,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:11,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:44:11,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:11,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f654058234569b79a1fe85 HTTP/1.1" 200 None 2026-05-04 19:44:11,816 - lava_callback - ERROR - Error processing callback for node 69f654058234569b79a1fe85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:44:49,326 - lava_callback - INFO - Received callback for node 69f654248234569b79a1fe95 INFO: 172.20.0.1:52500 - "POST /node/69f654248234569b79a1fe95 HTTP/1.0" 202 Accepted 2026-05-04 19:44:49,331 - lava_callback - INFO - Starting async job submit for node 69f654248234569b79a1fe95 2026-05-04 19:44:49,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:49,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654248234569b79a1fe95 HTTP/1.1" 200 None 2026-05-04 19:44:49,358 - lava_callback - DEBUG - Processing node 69f654248234569b79a1fe95: baseline-arm-baylibre 2026-05-04 19:44:49,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f654248234569b79a1fe95 2026-05-04 19:44:49,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:49,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654248234569b79a1fe95 HTTP/1.1" 200 None 2026-05-04 19:44:49,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:49,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:44:49,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:44:49,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f654248234569b79a1fe95 HTTP/1.1" 200 None 2026-05-04 19:44:49,403 - lava_callback - ERROR - Error processing callback for node 69f654248234569b79a1fe95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40160 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:46:11,858 - lava_callback - INFO - Received callback for node 69f6547e8234569b79a1feb3 INFO: 172.20.0.1:42480 - "POST /node/69f6547e8234569b79a1feb3 HTTP/1.0" 202 Accepted 2026-05-04 19:46:11,863 - lava_callback - INFO - Starting async job submit for node 69f6547e8234569b79a1feb3 2026-05-04 19:46:11,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:46:11,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6547e8234569b79a1feb3 HTTP/1.1" 200 None 2026-05-04 19:46:11,879 - lava_callback - DEBUG - Processing node 69f6547e8234569b79a1feb3: baseline-arm64-clabbe 2026-05-04 19:46:11,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6547e8234569b79a1feb3 2026-05-04 19:46:11,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:46:11,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6547e8234569b79a1feb3 HTTP/1.1" 200 None 2026-05-04 19:46:11,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:46:11,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-04 19:46:11,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:46:11,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6547e8234569b79a1feb3 HTTP/1.1" 200 None 2026-05-04 19:46:11,923 - lava_callback - ERROR - Error processing callback for node 69f6547e8234569b79a1feb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35396 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:47:09,361 - lava_callback - INFO - Received callback for node 69f654b58234569b79a1fed3 INFO: 172.20.0.1:35406 - "POST /node/69f654b58234569b79a1fed3 HTTP/1.0" 202 Accepted 2026-05-04 19:47:09,367 - lava_callback - INFO - Starting async job submit for node 69f654b58234569b79a1fed3 2026-05-04 19:47:09,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:09,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654b58234569b79a1fed3 HTTP/1.1" 200 None 2026-05-04 19:47:09,381 - lava_callback - DEBUG - Processing node 69f654b58234569b79a1fed3: baseline-arm-baylibre 2026-05-04 19:47:09,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f654b58234569b79a1fed3 2026-05-04 19:47:09,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:09,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654b58234569b79a1fed3 HTTP/1.1" 200 None 2026-05-04 19:47:09,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:09,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:47:09,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:09,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f654b58234569b79a1fed3 HTTP/1.1" 200 None 2026-05-04 19:47:09,460 - lava_callback - ERROR - Error processing callback for node 69f654b58234569b79a1fed3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60540 - "GET /node/698b77690a16aea5a0dc8324%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43580 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:47:49,327 - lava_callback - INFO - Received callback for node 69f654d98234569b79a1fee9 INFO: 172.20.0.1:43586 - "POST /node/69f654d98234569b79a1fee9 HTTP/1.0" 202 Accepted 2026-05-04 19:47:49,332 - lava_callback - INFO - Starting async job submit for node 69f654d98234569b79a1fee9 2026-05-04 19:47:49,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:49,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654d98234569b79a1fee9 HTTP/1.1" 200 None 2026-05-04 19:47:49,348 - lava_callback - DEBUG - Processing node 69f654d98234569b79a1fee9: baseline-arm-baylibre 2026-05-04 19:47:49,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f654d98234569b79a1fee9 2026-05-04 19:47:49,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:49,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f654d98234569b79a1fee9 HTTP/1.1" 200 None 2026-05-04 19:47:49,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:49,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:47:49,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:47:49,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f654d98234569b79a1fee9 HTTP/1.1" 200 None 2026-05-04 19:47:49,394 - lava_callback - ERROR - Error processing callback for node 69f654d98234569b79a1fee9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43404 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:49:12,033 - lava_callback - INFO - Received callback for node 69f655278234569b79a1ff01 INFO: 172.20.0.1:39976 - "POST /node/69f655278234569b79a1ff01 HTTP/1.0" 202 Accepted 2026-05-04 19:49:12,039 - lava_callback - INFO - Starting async job submit for node 69f655278234569b79a1ff01 2026-05-04 19:49:12,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:12,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655278234569b79a1ff01 HTTP/1.1" 200 None 2026-05-04 19:49:12,054 - lava_callback - DEBUG - Processing node 69f655278234569b79a1ff01: baseline-arm-clabbe 2026-05-04 19:49:12,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f655278234569b79a1ff01 2026-05-04 19:49:12,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:12,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655278234569b79a1ff01 HTTP/1.1" 200 None 2026-05-04 19:49:12,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:12,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:49:12,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:12,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f655278234569b79a1ff01 HTTP/1.1" 200 None 2026-05-04 19:49:12,128 - lava_callback - ERROR - Error processing callback for node 69f655278234569b79a1ff01: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:49:29,562 - lava_callback - INFO - Received callback for node 69f655478234569b79a1ff11 INFO: 172.20.0.1:54396 - "POST /node/69f655478234569b79a1ff11 HTTP/1.0" 202 Accepted 2026-05-04 19:49:29,568 - lava_callback - INFO - Starting async job submit for node 69f655478234569b79a1ff11 2026-05-04 19:49:29,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:29,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655478234569b79a1ff11 HTTP/1.1" 200 None 2026-05-04 19:49:29,584 - lava_callback - DEBUG - Processing node 69f655478234569b79a1ff11: baseline-arm-baylibre 2026-05-04 19:49:29,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f655478234569b79a1ff11 2026-05-04 19:49:29,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:29,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655478234569b79a1ff11 HTTP/1.1" 200 None 2026-05-04 19:49:29,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:29,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:49:29,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:49:29,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f655478234569b79a1ff11 HTTP/1.1" 200 None 2026-05-04 19:49:29,629 - lava_callback - ERROR - Error processing callback for node 69f655478234569b79a1ff11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56212 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:50:12,253 - lava_callback - INFO - Received callback for node 69f6556f8234569b79a1ff22 INFO: 172.20.0.1:51018 - "POST /node/69f6556f8234569b79a1ff22 HTTP/1.0" 202 Accepted 2026-05-04 19:50:12,259 - lava_callback - INFO - Starting async job submit for node 69f6556f8234569b79a1ff22 2026-05-04 19:50:12,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:12,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6556f8234569b79a1ff22 HTTP/1.1" 200 None 2026-05-04 19:50:12,275 - lava_callback - DEBUG - Processing node 69f6556f8234569b79a1ff22: baseline-arm-clabbe 2026-05-04 19:50:12,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6556f8234569b79a1ff22 2026-05-04 19:50:12,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:12,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6556f8234569b79a1ff22 HTTP/1.1" 200 None 2026-05-04 19:50:12,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:12,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:50:12,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:12,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6556f8234569b79a1ff22 HTTP/1.1" 200 None 2026-05-04 19:50:12,329 - lava_callback - ERROR - Error processing callback for node 69f6556f8234569b79a1ff22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47306 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:50:52,030 - lava_callback - INFO - Received callback for node 69f655948234569b79a1ff2c INFO: 172.20.0.1:40850 - "POST /node/69f655948234569b79a1ff2c HTTP/1.0" 202 Accepted 2026-05-04 19:50:52,036 - lava_callback - INFO - Starting async job submit for node 69f655948234569b79a1ff2c 2026-05-04 19:50:52,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:52,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655948234569b79a1ff2c HTTP/1.1" 200 None 2026-05-04 19:50:52,061 - lava_callback - DEBUG - Processing node 69f655948234569b79a1ff2c: baseline-arm-clabbe 2026-05-04 19:50:52,061 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f655948234569b79a1ff2c 2026-05-04 19:50:52,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:52,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655948234569b79a1ff2c HTTP/1.1" 200 None 2026-05-04 19:50:52,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:52,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:50:52,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:50:52,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f655948234569b79a1ff2c HTTP/1.1" 200 None 2026-05-04 19:50:52,106 - lava_callback - ERROR - Error processing callback for node 69f655948234569b79a1ff2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:52:12,118 - lava_callback - INFO - Received callback for node 69f655de8234569b79a1ff46 INFO: 172.20.0.1:46692 - "POST /node/69f655de8234569b79a1ff46 HTTP/1.0" 202 Accepted 2026-05-04 19:52:12,124 - lava_callback - INFO - Starting async job submit for node 69f655de8234569b79a1ff46 2026-05-04 19:52:12,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:52:12,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655de8234569b79a1ff46 HTTP/1.1" 200 None 2026-05-04 19:52:12,139 - lava_callback - DEBUG - Processing node 69f655de8234569b79a1ff46: baseline-arm-clabbe 2026-05-04 19:52:12,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f655de8234569b79a1ff46 2026-05-04 19:52:12,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:52:12,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f655de8234569b79a1ff46 HTTP/1.1" 200 None 2026-05-04 19:52:12,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:52:12,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:52:12,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:52:12,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f655de8234569b79a1ff46 HTTP/1.1" 200 None 2026-05-04 19:52:12,184 - lava_callback - ERROR - Error processing callback for node 69f655de8234569b79a1ff46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40938 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:53:32,197 - lava_callback - INFO - Received callback for node 69f656298234569b79a1ff61 INFO: 172.20.0.1:45530 - "POST /node/69f656298234569b79a1ff61 HTTP/1.0" 202 Accepted 2026-05-04 19:53:32,202 - lava_callback - INFO - Starting async job submit for node 69f656298234569b79a1ff61 2026-05-04 19:53:32,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:53:32,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656298234569b79a1ff61 HTTP/1.1" 200 None 2026-05-04 19:53:32,225 - lava_callback - DEBUG - Processing node 69f656298234569b79a1ff61: baseline-arm-clabbe 2026-05-04 19:53:32,226 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f656298234569b79a1ff61 2026-05-04 19:53:32,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:53:32,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656298234569b79a1ff61 HTTP/1.1" 200 None 2026-05-04 19:53:32,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:53:32,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:53:32,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:53:32,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f656298234569b79a1ff61 HTTP/1.1" 200 None 2026-05-04 19:53:32,270 - lava_callback - ERROR - Error processing callback for node 69f656298234569b79a1ff61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49860 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:54:32,269 - lava_callback - INFO - Received callback for node 69f656728234569b79a1ff7c INFO: 172.20.0.1:42390 - "POST /node/69f656728234569b79a1ff7c HTTP/1.0" 202 Accepted 2026-05-04 19:54:32,275 - lava_callback - INFO - Starting async job submit for node 69f656728234569b79a1ff7c 2026-05-04 19:54:32,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:54:32,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656728234569b79a1ff7c HTTP/1.1" 200 None 2026-05-04 19:54:32,290 - lava_callback - DEBUG - Processing node 69f656728234569b79a1ff7c: baseline-arm-clabbe 2026-05-04 19:54:32,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f656728234569b79a1ff7c 2026-05-04 19:54:32,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:54:32,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656728234569b79a1ff7c HTTP/1.1" 200 None 2026-05-04 19:54:32,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:54:32,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:54:32,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:54:32,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f656728234569b79a1ff7c HTTP/1.1" 200 None 2026-05-04 19:54:32,337 - lava_callback - ERROR - Error processing callback for node 69f656728234569b79a1ff7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32870 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:55:12,141 - lava_callback - INFO - Received callback for node 69f656968234569b79a1ff88 INFO: 172.20.0.1:56574 - "POST /node/69f656968234569b79a1ff88 HTTP/1.0" 202 Accepted 2026-05-04 19:55:12,148 - lava_callback - INFO - Starting async job submit for node 69f656968234569b79a1ff88 2026-05-04 19:55:12,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:12,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656968234569b79a1ff88 HTTP/1.1" 200 None 2026-05-04 19:55:12,172 - lava_callback - DEBUG - Processing node 69f656968234569b79a1ff88: baseline-arm-clabbe 2026-05-04 19:55:12,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f656968234569b79a1ff88 2026-05-04 19:55:12,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:12,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656968234569b79a1ff88 HTTP/1.1" 200 None 2026-05-04 19:55:12,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:12,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:55:12,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:12,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f656968234569b79a1ff88 HTTP/1.1" 200 None 2026-05-04 19:55:12,217 - lava_callback - ERROR - Error processing callback for node 69f656968234569b79a1ff88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57212 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:55:49,886 - lava_callback - INFO - Received callback for node 69f656b98234569b79a1ff94 INFO: 172.20.0.1:35468 - "POST /node/69f656b98234569b79a1ff94 HTTP/1.0" 202 Accepted 2026-05-04 19:55:49,891 - lava_callback - INFO - Starting async job submit for node 69f656b98234569b79a1ff94 2026-05-04 19:55:49,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:49,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656b98234569b79a1ff94 HTTP/1.1" 200 None 2026-05-04 19:55:49,907 - lava_callback - DEBUG - Processing node 69f656b98234569b79a1ff94: baseline-arm-baylibre 2026-05-04 19:55:49,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f656b98234569b79a1ff94 2026-05-04 19:55:49,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:49,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f656b98234569b79a1ff94 HTTP/1.1" 200 None 2026-05-04 19:55:49,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:49,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:55:49,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:55:49,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f656b98234569b79a1ff94 HTTP/1.1" 200 None 2026-05-04 19:55:49,969 - lava_callback - ERROR - Error processing callback for node 69f656b98234569b79a1ff94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53536 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:57:12,376 - lava_callback - INFO - Received callback for node 69f657048234569b79a1ffac INFO: 172.20.0.1:54470 - "POST /node/69f657048234569b79a1ffac HTTP/1.0" 202 Accepted 2026-05-04 19:57:12,381 - lava_callback - INFO - Starting async job submit for node 69f657048234569b79a1ffac 2026-05-04 19:57:12,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:57:12,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f657048234569b79a1ffac HTTP/1.1" 200 None 2026-05-04 19:57:12,398 - lava_callback - DEBUG - Processing node 69f657048234569b79a1ffac: baseline-arm-clabbe 2026-05-04 19:57:12,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f657048234569b79a1ffac 2026-05-04 19:57:12,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:57:12,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f657048234569b79a1ffac HTTP/1.1" 200 None 2026-05-04 19:57:12,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:57:12,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:57:12,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:57:12,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f657048234569b79a1ffac HTTP/1.1" 200 None 2026-05-04 19:57:12,444 - lava_callback - ERROR - Error processing callback for node 69f657048234569b79a1ffac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45602 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:45616 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:58:09,925 - lava_callback - INFO - Received callback for node 69f6574c8234569b79a1ffc8 INFO: 172.20.0.1:58132 - "POST /node/69f6574c8234569b79a1ffc8 HTTP/1.0" 202 Accepted 2026-05-04 19:58:09,930 - lava_callback - INFO - Starting async job submit for node 69f6574c8234569b79a1ffc8 2026-05-04 19:58:09,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:58:09,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6574c8234569b79a1ffc8 HTTP/1.1" 200 None 2026-05-04 19:58:09,946 - lava_callback - DEBUG - Processing node 69f6574c8234569b79a1ffc8: baseline-arm-baylibre 2026-05-04 19:58:09,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6574c8234569b79a1ffc8 2026-05-04 19:58:09,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:58:09,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6574c8234569b79a1ffc8 HTTP/1.1" 200 None 2026-05-04 19:58:09,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:58:09,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:58:09,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:58:09,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6574c8234569b79a1ffc8 HTTP/1.1" 200 None 2026-05-04 19:58:09,995 - lava_callback - ERROR - Error processing callback for node 69f6574c8234569b79a1ffc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33306 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38262 - "GET / HTTP/1.0" 200 OK 2026-05-04 19:59:32,499 - lava_callback - INFO - Received callback for node 69f657958234569b79a1ffde INFO: 172.20.0.1:38256 - "POST /node/69f657958234569b79a1ffde HTTP/1.0" 202 Accepted 2026-05-04 19:59:32,504 - lava_callback - INFO - Starting async job submit for node 69f657958234569b79a1ffde 2026-05-04 19:59:32,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:59:32,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f657958234569b79a1ffde HTTP/1.1" 200 None 2026-05-04 19:59:32,520 - lava_callback - DEBUG - Processing node 69f657958234569b79a1ffde: baseline-arm-clabbe 2026-05-04 19:59:32,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f657958234569b79a1ffde 2026-05-04 19:59:32,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:59:32,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f657958234569b79a1ffde HTTP/1.1" 200 None 2026-05-04 19:59:32,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:59:32,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 19:59:32,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 19:59:32,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f657958234569b79a1ffde HTTP/1.1" 200 None 2026-05-04 19:59:32,572 - lava_callback - ERROR - Error processing callback for node 69f657958234569b79a1ffde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44172 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:00:12,972 - lava_callback - INFO - Received callback for node 69f657bb8234569b79a1ffe9 INFO: 172.20.0.1:50570 - "POST /node/69f657bb8234569b79a1ffe9 HTTP/1.0" 202 Accepted 2026-05-04 20:00:12,977 - lava_callback - INFO - Starting async job submit for node 69f657bb8234569b79a1ffe9 2026-05-04 20:00:12,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:00:12,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f657bb8234569b79a1ffe9 HTTP/1.1" 200 None 2026-05-04 20:00:12,992 - lava_callback - DEBUG - Processing node 69f657bb8234569b79a1ffe9: baseline-arm-clabbe 2026-05-04 20:00:12,992 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f657bb8234569b79a1ffe9 2026-05-04 20:00:12,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:00:13,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f657bb8234569b79a1ffe9 HTTP/1.1" 200 None 2026-05-04 20:00:13,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:00:13,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 20:00:13,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:00:13,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f657bb8234569b79a1ffe9 HTTP/1.1" 200 None 2026-05-04 20:00:13,037 - lava_callback - ERROR - Error processing callback for node 69f657bb8234569b79a1ffe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48374 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:01:52,573 - lava_callback - INFO - Received callback for node 69f658298234569b79a2000a INFO: 172.20.0.1:32790 - "POST /node/69f658298234569b79a2000a HTTP/1.0" 202 Accepted 2026-05-04 20:01:52,578 - lava_callback - INFO - Starting async job submit for node 69f658298234569b79a2000a 2026-05-04 20:01:52,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:01:52,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658298234569b79a2000a HTTP/1.1" 200 None 2026-05-04 20:01:52,593 - lava_callback - DEBUG - Processing node 69f658298234569b79a2000a: baseline-arm-clabbe 2026-05-04 20:01:52,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f658298234569b79a2000a 2026-05-04 20:01:52,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:01:52,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658298234569b79a2000a HTTP/1.1" 200 None 2026-05-04 20:01:52,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:01:52,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 20:01:52,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:01:52,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f658298234569b79a2000a HTTP/1.1" 200 None 2026-05-04 20:01:52,649 - lava_callback - ERROR - Error processing callback for node 69f658298234569b79a2000a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42380 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:02:32,546 - lava_callback - INFO - Received callback for node 69f6584d8234569b79a20017 INFO: 172.20.0.1:49898 - "POST /node/69f6584d8234569b79a20017 HTTP/1.0" 202 Accepted 2026-05-04 20:02:32,552 - lava_callback - INFO - Starting async job submit for node 69f6584d8234569b79a20017 2026-05-04 20:02:32,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:02:32,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6584d8234569b79a20017 HTTP/1.1" 200 None 2026-05-04 20:02:32,567 - lava_callback - DEBUG - Processing node 69f6584d8234569b79a20017: baseline-arm-clabbe 2026-05-04 20:02:32,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6584d8234569b79a20017 2026-05-04 20:02:32,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:02:32,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6584d8234569b79a20017 HTTP/1.1" 200 None 2026-05-04 20:02:32,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:02:32,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 20:02:32,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:02:32,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6584d8234569b79a20017 HTTP/1.1" 200 None 2026-05-04 20:02:32,616 - lava_callback - ERROR - Error processing callback for node 69f6584d8234569b79a20017: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53328 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:03:10,196 - lava_callback - INFO - Received callback for node 69f658768234569b79a20022 INFO: 172.20.0.1:46650 - "POST /node/69f658768234569b79a20022 HTTP/1.0" 202 Accepted 2026-05-04 20:03:10,202 - lava_callback - INFO - Starting async job submit for node 69f658768234569b79a20022 2026-05-04 20:03:10,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:03:10,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658768234569b79a20022 HTTP/1.1" 200 None 2026-05-04 20:03:10,223 - lava_callback - DEBUG - Processing node 69f658768234569b79a20022: baseline-arm64-baylibre 2026-05-04 20:03:10,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f658768234569b79a20022 2026-05-04 20:03:10,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:03:10,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658768234569b79a20022 HTTP/1.1" 200 None 2026-05-04 20:03:10,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:03:10,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:03:10,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:03:10,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f658768234569b79a20022 HTTP/1.1" 200 None 2026-05-04 20:03:10,282 - lava_callback - ERROR - Error processing callback for node 69f658768234569b79a20022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46566 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:04:32,747 - lava_callback - INFO - Received callback for node 69f658bb8234569b79a20048 INFO: 172.20.0.1:49102 - "POST /node/69f658bb8234569b79a20048 HTTP/1.0" 202 Accepted 2026-05-04 20:04:32,753 - lava_callback - INFO - Starting async job submit for node 69f658bb8234569b79a20048 2026-05-04 20:04:32,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:04:32,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658bb8234569b79a20048 HTTP/1.1" 200 None 2026-05-04 20:04:32,768 - lava_callback - DEBUG - Processing node 69f658bb8234569b79a20048: baseline-arm-clabbe 2026-05-04 20:04:32,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f658bb8234569b79a20048 2026-05-04 20:04:32,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:04:32,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658bb8234569b79a20048 HTTP/1.1" 200 None 2026-05-04 20:04:32,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:04:32,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 20:04:32,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:04:32,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f658bb8234569b79a20048 HTTP/1.1" 200 None 2026-05-04 20:04:32,822 - lava_callback - ERROR - Error processing callback for node 69f658bb8234569b79a20048: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51982 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:05:10,310 - lava_callback - INFO - Received callback for node 69f658e38234569b79a20053 INFO: 172.20.0.1:39304 - "POST /node/69f658e38234569b79a20053 HTTP/1.0" 202 Accepted 2026-05-04 20:05:10,317 - lava_callback - INFO - Starting async job submit for node 69f658e38234569b79a20053 2026-05-04 20:05:10,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:05:10,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658e38234569b79a20053 HTTP/1.1" 200 None 2026-05-04 20:05:10,342 - lava_callback - DEBUG - Processing node 69f658e38234569b79a20053: baseline-arm64-baylibre 2026-05-04 20:05:10,343 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f658e38234569b79a20053 2026-05-04 20:05:10,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:05:10,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f658e38234569b79a20053 HTTP/1.1" 200 None 2026-05-04 20:05:10,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:05:10,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:05:10,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:05:10,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f658e38234569b79a20053 HTTP/1.1" 200 None 2026-05-04 20:05:10,403 - lava_callback - ERROR - Error processing callback for node 69f658e38234569b79a20053: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38414 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:06:10,337 - lava_callback - INFO - Received callback for node 69f6592d8234569b79a20073 INFO: 172.20.0.1:55858 - "POST /node/69f6592d8234569b79a20073 HTTP/1.0" 202 Accepted 2026-05-04 20:06:10,343 - lava_callback - INFO - Starting async job submit for node 69f6592d8234569b79a20073 2026-05-04 20:06:10,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:06:10,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6592d8234569b79a20073 HTTP/1.1" 200 None 2026-05-04 20:06:10,358 - lava_callback - DEBUG - Processing node 69f6592d8234569b79a20073: baseline-arm64-baylibre 2026-05-04 20:06:10,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6592d8234569b79a20073 2026-05-04 20:06:10,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:06:10,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6592d8234569b79a20073 HTTP/1.1" 200 None 2026-05-04 20:06:10,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:06:10,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:06:10,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:06:10,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6592d8234569b79a20073 HTTP/1.1" 200 None 2026-05-04 20:06:10,404 - lava_callback - ERROR - Error processing callback for node 69f6592d8234569b79a20073: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50434 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:08:10,517 - lava_callback - INFO - Received callback for node 69f659998234569b79a200ac INFO: 172.20.0.1:39146 - "POST /node/69f659998234569b79a200ac HTTP/1.0" 202 Accepted 2026-05-04 20:08:10,522 - lava_callback - INFO - Starting async job submit for node 69f659998234569b79a200ac 2026-05-04 20:08:10,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:08:10,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f659998234569b79a200ac HTTP/1.1" 200 None 2026-05-04 20:08:10,548 - lava_callback - DEBUG - Processing node 69f659998234569b79a200ac: baseline-arm64-baylibre 2026-05-04 20:08:10,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f659998234569b79a200ac 2026-05-04 20:08:10,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:08:10,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f659998234569b79a200ac HTTP/1.1" 200 None 2026-05-04 20:08:10,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:08:10,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:08:10,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:08:10,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f659998234569b79a200ac HTTP/1.1" 200 None 2026-05-04 20:08:10,632 - lava_callback - ERROR - Error processing callback for node 69f659998234569b79a200ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50224 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:09:10,540 - lava_callback - INFO - Received callback for node 69f659e18234569b79a200ce INFO: 172.20.0.1:32942 - "POST /node/69f659e18234569b79a200ce HTTP/1.0" 202 Accepted 2026-05-04 20:09:10,546 - lava_callback - INFO - Starting async job submit for node 69f659e18234569b79a200ce 2026-05-04 20:09:10,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:09:10,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f659e18234569b79a200ce HTTP/1.1" 200 None 2026-05-04 20:09:10,565 - lava_callback - DEBUG - Processing node 69f659e18234569b79a200ce: baseline-arm64-baylibre 2026-05-04 20:09:10,566 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f659e18234569b79a200ce 2026-05-04 20:09:10,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:09:10,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f659e18234569b79a200ce HTTP/1.1" 200 None 2026-05-04 20:09:10,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:09:10,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:09:10,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:09:10,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f659e18234569b79a200ce HTTP/1.1" 200 None 2026-05-04 20:09:10,610 - lava_callback - ERROR - Error processing callback for node 69f659e18234569b79a200ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55054 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:11:10,622 - lava_callback - INFO - Received callback for node 69f65a4f8234569b79a2010b INFO: 172.20.0.1:37112 - "POST /node/69f65a4f8234569b79a2010b HTTP/1.0" 202 Accepted 2026-05-04 20:11:10,627 - lava_callback - INFO - Starting async job submit for node 69f65a4f8234569b79a2010b 2026-05-04 20:11:10,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:11:10,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65a4f8234569b79a2010b HTTP/1.1" 200 None 2026-05-04 20:11:10,672 - lava_callback - DEBUG - Processing node 69f65a4f8234569b79a2010b: baseline-arm64-baylibre 2026-05-04 20:11:10,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65a4f8234569b79a2010b 2026-05-04 20:11:10,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:11:10,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65a4f8234569b79a2010b HTTP/1.1" 200 None 2026-05-04 20:11:10,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:11:10,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:11:10,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:11:10,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65a4f8234569b79a2010b HTTP/1.1" 200 None 2026-05-04 20:11:10,746 - lava_callback - ERROR - Error processing callback for node 69f65a4f8234569b79a2010b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55280 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:12:10,633 - lava_callback - INFO - Received callback for node 69f65a988234569b79a20139 INFO: 172.20.0.1:53612 - "POST /node/69f65a988234569b79a20139 HTTP/1.0" 202 Accepted 2026-05-04 20:12:10,638 - lava_callback - INFO - Starting async job submit for node 69f65a988234569b79a20139 2026-05-04 20:12:10,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:12:10,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65a988234569b79a20139 HTTP/1.1" 200 None 2026-05-04 20:12:10,653 - lava_callback - DEBUG - Processing node 69f65a988234569b79a20139: baseline-arm64-baylibre 2026-05-04 20:12:10,653 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65a988234569b79a20139 2026-05-04 20:12:10,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:12:10,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65a988234569b79a20139 HTTP/1.1" 200 None 2026-05-04 20:12:10,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:12:10,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:12:10,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:12:10,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65a988234569b79a20139 HTTP/1.1" 200 None 2026-05-04 20:12:10,714 - lava_callback - ERROR - Error processing callback for node 69f65a988234569b79a20139: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:13:33,099 - lava_callback - INFO - Received callback for node 69f65ad98234569b79a2015f INFO: 172.20.0.1:50854 - "POST /node/69f65ad98234569b79a2015f HTTP/1.0" 202 Accepted 2026-05-04 20:13:33,105 - lava_callback - INFO - Starting async job submit for node 69f65ad98234569b79a2015f 2026-05-04 20:13:33,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:13:33,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65ad98234569b79a2015f HTTP/1.1" 200 None 2026-05-04 20:13:33,120 - lava_callback - DEBUG - Processing node 69f65ad98234569b79a2015f: baseline-arm-clabbe 2026-05-04 20:13:33,120 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65ad98234569b79a2015f 2026-05-04 20:13:33,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:13:33,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65ad98234569b79a2015f HTTP/1.1" 200 None 2026-05-04 20:13:33,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:13:33,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac204a965ba0e0b77448 HTTP/1.1" 200 None 2026-05-04 20:13:33,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:13:33,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65ad98234569b79a2015f HTTP/1.1" 200 None 2026-05-04 20:13:33,166 - lava_callback - ERROR - Error processing callback for node 69f65ad98234569b79a2015f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:14:10,824 - lava_callback - INFO - Received callback for node 69f65b038234569b79a2016a INFO: 172.20.0.1:34946 - "POST /node/69f65b038234569b79a2016a HTTP/1.0" 202 Accepted 2026-05-04 20:14:10,829 - lava_callback - INFO - Starting async job submit for node 69f65b038234569b79a2016a 2026-05-04 20:14:10,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:14:10,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65b038234569b79a2016a HTTP/1.1" 200 None 2026-05-04 20:14:10,855 - lava_callback - DEBUG - Processing node 69f65b038234569b79a2016a: baseline-arm64-baylibre 2026-05-04 20:14:10,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65b038234569b79a2016a 2026-05-04 20:14:10,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:14:10,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65b038234569b79a2016a HTTP/1.1" 200 None 2026-05-04 20:14:10,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:14:10,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:14:10,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:14:10,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65b038234569b79a2016a HTTP/1.1" 200 None 2026-05-04 20:14:10,924 - lava_callback - ERROR - Error processing callback for node 69f65b038234569b79a2016a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40958 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:15:10,982 - lava_callback - INFO - Received callback for node 69f65b4c8234569b79a2019c INFO: 172.20.0.1:44994 - "POST /node/69f65b4c8234569b79a2019c HTTP/1.0" 202 Accepted 2026-05-04 20:15:10,988 - lava_callback - INFO - Starting async job submit for node 69f65b4c8234569b79a2019c 2026-05-04 20:15:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:15:11,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65b4c8234569b79a2019c HTTP/1.1" 200 None 2026-05-04 20:15:11,019 - lava_callback - DEBUG - Processing node 69f65b4c8234569b79a2019c: baseline-arm64-baylibre 2026-05-04 20:15:11,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65b4c8234569b79a2019c 2026-05-04 20:15:11,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:15:11,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65b4c8234569b79a2019c HTTP/1.1" 200 None 2026-05-04 20:15:11,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:15:11,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:15:11,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:15:11,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65b4c8234569b79a2019c HTTP/1.1" 200 None 2026-05-04 20:15:11,064 - lava_callback - ERROR - Error processing callback for node 69f65b4c8234569b79a2019c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43008 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:16:30,901 - lava_callback - INFO - Received callback for node 69f65b948234569b79a201be INFO: 172.20.0.1:42164 - "POST /node/69f65b948234569b79a201be HTTP/1.0" 202 Accepted 2026-05-04 20:16:30,907 - lava_callback - INFO - Starting async job submit for node 69f65b948234569b79a201be 2026-05-04 20:16:30,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:16:30,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65b948234569b79a201be HTTP/1.1" 200 None 2026-05-04 20:16:30,922 - lava_callback - DEBUG - Processing node 69f65b948234569b79a201be: baseline-arm64-baylibre 2026-05-04 20:16:30,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65b948234569b79a201be 2026-05-04 20:16:30,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:16:30,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65b948234569b79a201be HTTP/1.1" 200 None 2026-05-04 20:16:30,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:16:30,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:16:30,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:16:30,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65b948234569b79a201be HTTP/1.1" 200 None 2026-05-04 20:16:30,969 - lava_callback - ERROR - Error processing callback for node 69f65b948234569b79a201be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38776 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:38788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35686 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.20.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:17:53,206 - lava_callback - INFO - Received callback for node 69f65be38234569b79a201ee INFO: 172.20.0.1:39672 - "POST /node/69f65be38234569b79a201ee HTTP/1.0" 202 Accepted 2026-05-04 20:17:53,211 - lava_callback - INFO - Starting async job submit for node 69f65be38234569b79a201ee 2026-05-04 20:17:53,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:17:53,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65be38234569b79a201ee HTTP/1.1" 200 None 2026-05-04 20:17:53,232 - lava_callback - DEBUG - Processing node 69f65be38234569b79a201ee: baseline-arm64-clabbe 2026-05-04 20:17:53,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65be38234569b79a201ee 2026-05-04 20:17:53,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:17:53,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65be38234569b79a201ee HTTP/1.1" 200 None 2026-05-04 20:17:53,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:17:53,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:17:53,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:17:53,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65be38234569b79a201ee HTTP/1.1" 200 None 2026-05-04 20:17:53,279 - lava_callback - ERROR - Error processing callback for node 69f65be38234569b79a201ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55482 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:18:51,064 - lava_callback - INFO - Received callback for node 69f65c288234569b79a2020b INFO: 172.20.0.1:48760 - "POST /node/69f65c288234569b79a2020b HTTP/1.0" 202 Accepted 2026-05-04 20:18:51,069 - lava_callback - INFO - Starting async job submit for node 69f65c288234569b79a2020b 2026-05-04 20:18:51,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:18:51,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65c288234569b79a2020b HTTP/1.1" 200 None 2026-05-04 20:18:51,088 - lava_callback - DEBUG - Processing node 69f65c288234569b79a2020b: baseline-arm64-baylibre 2026-05-04 20:18:51,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65c288234569b79a2020b 2026-05-04 20:18:51,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:18:51,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65c288234569b79a2020b HTTP/1.1" 200 None 2026-05-04 20:18:51,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:18:51,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:18:51,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:18:51,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65c288234569b79a2020b HTTP/1.1" 200 None 2026-05-04 20:18:51,133 - lava_callback - ERROR - Error processing callback for node 69f65c288234569b79a2020b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48772 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:19:04,000 - lava_callback - INFO - Received callback for node 69f8f1eb0573a8210e13189f INFO: 172.20.0.1:46544 - "POST /node/69f8f1eb0573a8210e13189f HTTP/1.0" 202 Accepted 2026-05-04 20:19:04,011 - lava_callback - INFO - Starting async job submit for node 69f8f1eb0573a8210e13189f 2026-05-04 20:19:04,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:04,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f1eb0573a8210e13189f HTTP/1.1" 200 None 2026-05-04 20:19:04,056 - lava_callback - DEBUG - Processing node 69f8f1eb0573a8210e13189f: baseline-arm64 2026-05-04 20:19:04,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 20:19:04,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 20:19:04,789 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8f1eb0573a8210e13189f/log.txt.gz 2026-05-04 20:19:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 20:19:05,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 20:19:05,214 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8f1eb0573a8210e13189f/lava-logs.yaml 2026-05-04 20:19:05,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 20:19:05,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 20:19:05,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69f8f1eb0573a8210e13189f/lava_callback.json.gz 2026-05-04 20:19:05,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:05,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f1eb0573a8210e13189f HTTP/1.1" 200 None 2026-05-04 20:19:05,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:05,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 20:19:05,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:05,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f1eb0573a8210e13189f HTTP/1.1" 200 None 2026-05-04 20:19:05,671 - lava_callback - INFO - Completed processing callback for node 69f8f1eb0573a8210e13189f INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33964 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:19:28,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:28,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54054 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:19:52,094 - lava_callback - INFO - Received callback for node 69f8faba0573a8210e131bf1 INFO: 172.20.0.1:41140 - "POST /node/69f8faba0573a8210e131bf1 HTTP/1.0" 202 Accepted 2026-05-04 20:19:52,102 - lava_callback - INFO - Starting async job submit for node 69f8faba0573a8210e131bf1 2026-05-04 20:19:52,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:52,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8faba0573a8210e131bf1 HTTP/1.1" 200 None 2026-05-04 20:19:52,164 - lava_callback - DEBUG - Processing node 69f8faba0573a8210e131bf1: baseline-nfs-arm64 2026-05-04 20:19:53,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 20:19:53,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 20:19:53,401 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8faba0573a8210e131bf1/log.txt.gz 2026-05-04 20:19:54,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 20:19:54,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 20:19:54,204 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8faba0573a8210e131bf1/lava-logs.yaml 2026-05-04 20:19:54,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 20:19:54,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 20:19:54,371 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8faba0573a8210e131bf1/lava_callback.json.gz DEBUG: Setup failed for 69f8faba0573a8210e131bf1. Transitting job node result: incomplete -> fail 2026-05-04 20:19:54,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:54,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8faba0573a8210e131bf1 HTTP/1.1" 200 None 2026-05-04 20:19:54,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:54,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 20:19:54,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:54,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8faba0573a8210e131bf1 HTTP/1.1" 200 None 2026-05-04 20:19:54,603 - lava_callback - INFO - Completed processing callback for node 69f8faba0573a8210e131bf1 INFO: 172.20.0.1:41148 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:19:58,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:19:58,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46778 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:20:11,225 - lava_callback - INFO - Received callback for node 69f65c708234569b79a2022a INFO: 172.20.0.1:42200 - "POST /node/69f65c708234569b79a2022a HTTP/1.0" 202 Accepted 2026-05-04 20:20:11,230 - lava_callback - INFO - Starting async job submit for node 69f65c708234569b79a2022a 2026-05-04 20:20:11,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:20:11,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65c708234569b79a2022a HTTP/1.1" 200 None 2026-05-04 20:20:11,245 - lava_callback - DEBUG - Processing node 69f65c708234569b79a2022a: baseline-arm64-baylibre 2026-05-04 20:20:11,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65c708234569b79a2022a 2026-05-04 20:20:11,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:20:11,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65c708234569b79a2022a HTTP/1.1" 200 None 2026-05-04 20:20:11,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:20:11,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:20:11,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:20:11,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65c708234569b79a2022a HTTP/1.1" 200 None 2026-05-04 20:20:11,291 - lava_callback - ERROR - Error processing callback for node 69f65c708234569b79a2022a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59152 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:21:33,398 - lava_callback - INFO - Received callback for node 69f65cbf8234569b79a20259 INFO: 172.20.0.1:46804 - "POST /node/69f65cbf8234569b79a20259 HTTP/1.0" 202 Accepted 2026-05-04 20:21:33,407 - lava_callback - INFO - Starting async job submit for node 69f65cbf8234569b79a20259 2026-05-04 20:21:33,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:21:33,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65cbf8234569b79a20259 HTTP/1.1" 200 None 2026-05-04 20:21:33,423 - lava_callback - DEBUG - Processing node 69f65cbf8234569b79a20259: baseline-arm64-clabbe 2026-05-04 20:21:33,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65cbf8234569b79a20259 2026-05-04 20:21:33,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:21:33,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65cbf8234569b79a20259 HTTP/1.1" 200 None 2026-05-04 20:21:33,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:21:33,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:21:33,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:21:33,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65cbf8234569b79a20259 HTTP/1.1" 200 None 2026-05-04 20:21:33,471 - lava_callback - ERROR - Error processing callback for node 69f65cbf8234569b79a20259: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57486 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:22:53,432 - lava_callback - INFO - Received callback for node 69f65d088234569b79a20276 INFO: 172.20.0.1:33218 - "POST /node/69f65d088234569b79a20276 HTTP/1.0" 202 Accepted 2026-05-04 20:22:53,438 - lava_callback - INFO - Starting async job submit for node 69f65d088234569b79a20276 2026-05-04 20:22:53,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:22:53,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65d088234569b79a20276 HTTP/1.1" 200 None 2026-05-04 20:22:53,452 - lava_callback - DEBUG - Processing node 69f65d088234569b79a20276: baseline-arm64-clabbe 2026-05-04 20:22:53,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65d088234569b79a20276 2026-05-04 20:22:53,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:22:53,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65d088234569b79a20276 HTTP/1.1" 200 None 2026-05-04 20:22:53,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:22:53,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:22:53,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:22:53,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65d088234569b79a20276 HTTP/1.1" 200 None 2026-05-04 20:22:53,533 - lava_callback - ERROR - Error processing callback for node 69f65d088234569b79a20276: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56254 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:23:53,509 - lava_callback - INFO - Received callback for node 69f65d508234569b79a202a3 INFO: 172.20.0.1:33496 - "POST /node/69f65d508234569b79a202a3 HTTP/1.0" 202 Accepted 2026-05-04 20:23:53,515 - lava_callback - INFO - Starting async job submit for node 69f65d508234569b79a202a3 2026-05-04 20:23:53,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:23:53,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65d508234569b79a202a3 HTTP/1.1" 200 None 2026-05-04 20:23:53,530 - lava_callback - DEBUG - Processing node 69f65d508234569b79a202a3: baseline-arm64-clabbe 2026-05-04 20:23:53,530 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65d508234569b79a202a3 2026-05-04 20:23:53,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:23:53,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65d508234569b79a202a3 HTTP/1.1" 200 None 2026-05-04 20:23:53,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:23:53,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:23:53,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:23:53,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65d508234569b79a202a3 HTTP/1.1" 200 None 2026-05-04 20:23:53,588 - lava_callback - ERROR - Error processing callback for node 69f65d508234569b79a202a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56168 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:25:13,518 - lava_callback - INFO - Received callback for node 69f65d9a8234569b79a202c1 INFO: 172.20.0.1:48620 - "POST /node/69f65d9a8234569b79a202c1 HTTP/1.0" 202 Accepted 2026-05-04 20:25:13,524 - lava_callback - INFO - Starting async job submit for node 69f65d9a8234569b79a202c1 2026-05-04 20:25:13,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:25:13,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65d9a8234569b79a202c1 HTTP/1.1" 200 None 2026-05-04 20:25:13,539 - lava_callback - DEBUG - Processing node 69f65d9a8234569b79a202c1: baseline-arm64-clabbe 2026-05-04 20:25:13,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65d9a8234569b79a202c1 2026-05-04 20:25:13,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:25:13,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65d9a8234569b79a202c1 HTTP/1.1" 200 None 2026-05-04 20:25:13,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:25:13,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:25:13,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:25:13,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65d9a8234569b79a202c1 HTTP/1.1" 200 None 2026-05-04 20:25:13,612 - lava_callback - ERROR - Error processing callback for node 69f65d9a8234569b79a202c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45594 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:27:33,565 - lava_callback - INFO - Received callback for node 69f65e2c8234569b79a2030b INFO: 172.20.0.1:40612 - "POST /node/69f65e2c8234569b79a2030b HTTP/1.0" 202 Accepted 2026-05-04 20:27:33,570 - lava_callback - INFO - Starting async job submit for node 69f65e2c8234569b79a2030b 2026-05-04 20:27:33,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:27:33,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65e2c8234569b79a2030b HTTP/1.1" 200 None 2026-05-04 20:27:33,585 - lava_callback - DEBUG - Processing node 69f65e2c8234569b79a2030b: baseline-arm64-clabbe 2026-05-04 20:27:33,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65e2c8234569b79a2030b 2026-05-04 20:27:33,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:27:33,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65e2c8234569b79a2030b HTTP/1.1" 200 None 2026-05-04 20:27:33,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:27:33,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:27:33,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:27:33,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65e2c8234569b79a2030b HTTP/1.1" 200 None 2026-05-04 20:27:33,631 - lava_callback - ERROR - Error processing callback for node 69f65e2c8234569b79a2030b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35822 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:28:53,705 - lava_callback - INFO - Received callback for node 69f65e748234569b79a20329 INFO: 172.20.0.1:45832 - "POST /node/69f65e748234569b79a20329 HTTP/1.0" 202 Accepted 2026-05-04 20:28:53,711 - lava_callback - INFO - Starting async job submit for node 69f65e748234569b79a20329 2026-05-04 20:28:53,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:28:53,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65e748234569b79a20329 HTTP/1.1" 200 None 2026-05-04 20:28:53,727 - lava_callback - DEBUG - Processing node 69f65e748234569b79a20329: baseline-arm64-clabbe 2026-05-04 20:28:53,727 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65e748234569b79a20329 2026-05-04 20:28:53,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:28:53,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65e748234569b79a20329 HTTP/1.1" 200 None 2026-05-04 20:28:53,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:28:53,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:28:53,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:28:53,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65e748234569b79a20329 HTTP/1.1" 200 None 2026-05-04 20:28:53,773 - lava_callback - ERROR - Error processing callback for node 69f65e748234569b79a20329: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44138 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:29:53,676 - lava_callback - INFO - Received callback for node 69f65ebc8234569b79a20356 INFO: 172.20.0.1:52800 - "POST /node/69f65ebc8234569b79a20356 HTTP/1.0" 202 Accepted 2026-05-04 20:29:53,682 - lava_callback - INFO - Starting async job submit for node 69f65ebc8234569b79a20356 2026-05-04 20:29:53,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:29:53,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65ebc8234569b79a20356 HTTP/1.1" 200 None 2026-05-04 20:29:53,697 - lava_callback - DEBUG - Processing node 69f65ebc8234569b79a20356: baseline-arm64-clabbe 2026-05-04 20:29:53,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65ebc8234569b79a20356 2026-05-04 20:29:53,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:29:53,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65ebc8234569b79a20356 HTTP/1.1" 200 None 2026-05-04 20:29:53,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:29:53,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:29:53,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:29:53,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65ebc8234569b79a20356 HTTP/1.1" 200 None 2026-05-04 20:29:53,745 - lava_callback - ERROR - Error processing callback for node 69f65ebc8234569b79a20356: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37868 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:31:13,733 - lava_callback - INFO - Received callback for node 69f65f048234569b79a20372 INFO: 172.20.0.1:38506 - "POST /node/69f65f048234569b79a20372 HTTP/1.0" 202 Accepted 2026-05-04 20:31:13,738 - lava_callback - INFO - Starting async job submit for node 69f65f048234569b79a20372 2026-05-04 20:31:13,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:31:13,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65f048234569b79a20372 HTTP/1.1" 200 None 2026-05-04 20:31:13,754 - lava_callback - DEBUG - Processing node 69f65f048234569b79a20372: baseline-arm64-clabbe 2026-05-04 20:31:13,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65f048234569b79a20372 2026-05-04 20:31:13,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:31:13,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65f048234569b79a20372 HTTP/1.1" 200 None 2026-05-04 20:31:13,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:31:13,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:31:13,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:31:13,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65f048234569b79a20372 HTTP/1.1" 200 None 2026-05-04 20:31:13,800 - lava_callback - ERROR - Error processing callback for node 69f65f048234569b79a20372: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60336 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:32:33,767 - lava_callback - INFO - Received callback for node 69f65f4d8234569b79a203a1 INFO: 172.20.0.1:34340 - "POST /node/69f65f4d8234569b79a203a1 HTTP/1.0" 202 Accepted 2026-05-04 20:32:33,772 - lava_callback - INFO - Starting async job submit for node 69f65f4d8234569b79a203a1 2026-05-04 20:32:33,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:32:33,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65f4d8234569b79a203a1 HTTP/1.1" 200 None 2026-05-04 20:32:33,787 - lava_callback - DEBUG - Processing node 69f65f4d8234569b79a203a1: baseline-arm64-clabbe 2026-05-04 20:32:33,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65f4d8234569b79a203a1 2026-05-04 20:32:33,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:32:33,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65f4d8234569b79a203a1 HTTP/1.1" 200 None 2026-05-04 20:32:33,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:32:33,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:32:33,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:32:33,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65f4d8234569b79a203a1 HTTP/1.1" 200 None 2026-05-04 20:32:33,837 - lava_callback - ERROR - Error processing callback for node 69f65f4d8234569b79a203a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44020 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:33:31,864 - lava_callback - INFO - Received callback for node 69f65f8f8234569b79a203bd INFO: 172.20.0.1:39472 - "POST /node/69f65f8f8234569b79a203bd HTTP/1.0" 202 Accepted 2026-05-04 20:33:31,870 - lava_callback - INFO - Starting async job submit for node 69f65f8f8234569b79a203bd 2026-05-04 20:33:31,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:33:31,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65f8f8234569b79a203bd HTTP/1.1" 200 None 2026-05-04 20:33:31,885 - lava_callback - DEBUG - Processing node 69f65f8f8234569b79a203bd: baseline-arm64-baylibre 2026-05-04 20:33:31,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f65f8f8234569b79a203bd 2026-05-04 20:33:31,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:33:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f65f8f8234569b79a203bd HTTP/1.1" 200 None 2026-05-04 20:33:31,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:33:31,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:33:31,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:33:31,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f65f8f8234569b79a203bd HTTP/1.1" 200 None 2026-05-04 20:33:31,941 - lava_callback - ERROR - Error processing callback for node 69f65f8f8234569b79a203bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:35:53,941 - lava_callback - INFO - Received callback for node 69f660258234569b79a20409 INFO: 172.20.0.1:33954 - "POST /node/69f660258234569b79a20409 HTTP/1.0" 202 Accepted 2026-05-04 20:35:53,946 - lava_callback - INFO - Starting async job submit for node 69f660258234569b79a20409 2026-05-04 20:35:53,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:35:53,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f660258234569b79a20409 HTTP/1.1" 200 None 2026-05-04 20:35:53,964 - lava_callback - DEBUG - Processing node 69f660258234569b79a20409: baseline-arm64-clabbe 2026-05-04 20:35:53,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f660258234569b79a20409 2026-05-04 20:35:53,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:35:53,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f660258234569b79a20409 HTTP/1.1" 200 None 2026-05-04 20:35:53,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:35:53,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:35:53,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:35:54,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f660258234569b79a20409 HTTP/1.1" 200 None 2026-05-04 20:35:54,011 - lava_callback - ERROR - Error processing callback for node 69f660258234569b79a20409: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50050 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:37:13,944 - lava_callback - INFO - Received callback for node 69f6606d8234569b79a20426 INFO: 172.20.0.1:56690 - "POST /node/69f6606d8234569b79a20426 HTTP/1.0" 202 Accepted 2026-05-04 20:37:13,949 - lava_callback - INFO - Starting async job submit for node 69f6606d8234569b79a20426 2026-05-04 20:37:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:37:13,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6606d8234569b79a20426 HTTP/1.1" 200 None 2026-05-04 20:37:13,999 - lava_callback - DEBUG - Processing node 69f6606d8234569b79a20426: baseline-arm64-clabbe 2026-05-04 20:37:13,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6606d8234569b79a20426 2026-05-04 20:37:14,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:37:14,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6606d8234569b79a20426 HTTP/1.1" 200 None 2026-05-04 20:37:14,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:37:14,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:37:14,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:37:14,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6606d8234569b79a20426 HTTP/1.1" 200 None 2026-05-04 20:37:14,225 - lava_callback - ERROR - Error processing callback for node 69f6606d8234569b79a20426: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40974 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:38:34,016 - lava_callback - INFO - Received callback for node 69f660b58234569b79a20455 INFO: 172.20.0.1:59222 - "POST /node/69f660b58234569b79a20455 HTTP/1.0" 202 Accepted 2026-05-04 20:38:34,022 - lava_callback - INFO - Starting async job submit for node 69f660b58234569b79a20455 2026-05-04 20:38:34,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:38:34,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f660b58234569b79a20455 HTTP/1.1" 200 None 2026-05-04 20:38:34,056 - lava_callback - DEBUG - Processing node 69f660b58234569b79a20455: baseline-arm64-clabbe 2026-05-04 20:38:34,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f660b58234569b79a20455 2026-05-04 20:38:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:38:34,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f660b58234569b79a20455 HTTP/1.1" 200 None 2026-05-04 20:38:34,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:38:34,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:38:34,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:38:34,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f660b58234569b79a20455 HTTP/1.1" 200 None 2026-05-04 20:38:34,111 - lava_callback - ERROR - Error processing callback for node 69f660b58234569b79a20455: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46396 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:40:14,353 - lava_callback - INFO - Received callback for node 69f6611b8234569b79a20474 INFO: 172.20.0.1:56766 - "POST /node/69f6611b8234569b79a20474 HTTP/1.0" 202 Accepted 2026-05-04 20:40:14,359 - lava_callback - INFO - Starting async job submit for node 69f6611b8234569b79a20474 2026-05-04 20:40:14,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:40:14,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6611b8234569b79a20474 HTTP/1.1" 200 None 2026-05-04 20:40:14,374 - lava_callback - DEBUG - Processing node 69f6611b8234569b79a20474: baseline-arm64-clabbe 2026-05-04 20:40:14,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6611b8234569b79a20474 2026-05-04 20:40:14,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:40:14,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6611b8234569b79a20474 HTTP/1.1" 200 None 2026-05-04 20:40:14,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:40:14,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:40:14,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:40:14,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6611b8234569b79a20474 HTTP/1.1" 200 None 2026-05-04 20:40:14,439 - lava_callback - ERROR - Error processing callback for node 69f6611b8234569b79a20474: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:41:14,150 - lava_callback - INFO - Received callback for node 69f661648234569b79a20498 INFO: 172.20.0.1:34938 - "POST /node/69f661648234569b79a20498 HTTP/1.0" 202 Accepted 2026-05-04 20:41:14,155 - lava_callback - INFO - Starting async job submit for node 69f661648234569b79a20498 2026-05-04 20:41:14,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:41:14,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f661648234569b79a20498 HTTP/1.1" 200 None 2026-05-04 20:41:14,175 - lava_callback - DEBUG - Processing node 69f661648234569b79a20498: baseline-arm64-clabbe 2026-05-04 20:41:14,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f661648234569b79a20498 2026-05-04 20:41:14,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:41:14,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f661648234569b79a20498 HTTP/1.1" 200 None 2026-05-04 20:41:14,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:41:14,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:41:14,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:41:14,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f661648234569b79a20498 HTTP/1.1" 200 None 2026-05-04 20:41:14,246 - lava_callback - ERROR - Error processing callback for node 69f661648234569b79a20498: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46728 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:42:34,187 - lava_callback - INFO - Received callback for node 69f661ad8234569b79a204cd INFO: 172.20.0.1:33272 - "POST /node/69f661ad8234569b79a204cd HTTP/1.0" 202 Accepted 2026-05-04 20:42:34,193 - lava_callback - INFO - Starting async job submit for node 69f661ad8234569b79a204cd 2026-05-04 20:42:34,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:42:34,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f661ad8234569b79a204cd HTTP/1.1" 200 None 2026-05-04 20:42:34,208 - lava_callback - DEBUG - Processing node 69f661ad8234569b79a204cd: baseline-arm64-clabbe 2026-05-04 20:42:34,208 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f661ad8234569b79a204cd 2026-05-04 20:42:34,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:42:34,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f661ad8234569b79a204cd HTTP/1.1" 200 None 2026-05-04 20:42:34,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:42:34,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:42:34,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:42:34,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f661ad8234569b79a204cd HTTP/1.1" 200 None 2026-05-04 20:42:34,267 - lava_callback - ERROR - Error processing callback for node 69f661ad8234569b79a204cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56148 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:44:54,331 - lava_callback - INFO - Received callback for node 69f6623e8234569b79a20524 INFO: 172.20.0.1:57798 - "POST /node/69f6623e8234569b79a20524 HTTP/1.0" 202 Accepted 2026-05-04 20:44:54,337 - lava_callback - INFO - Starting async job submit for node 69f6623e8234569b79a20524 2026-05-04 20:44:54,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:44:54,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6623e8234569b79a20524 HTTP/1.1" 200 None 2026-05-04 20:44:54,354 - lava_callback - DEBUG - Processing node 69f6623e8234569b79a20524: baseline-arm64-clabbe 2026-05-04 20:44:54,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6623e8234569b79a20524 2026-05-04 20:44:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:44:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6623e8234569b79a20524 HTTP/1.1" 200 None 2026-05-04 20:44:54,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:44:54,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:44:54,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:44:54,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6623e8234569b79a20524 HTTP/1.1" 200 None 2026-05-04 20:44:54,400 - lava_callback - ERROR - Error processing callback for node 69f6623e8234569b79a20524: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52388 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:46:14,345 - lava_callback - INFO - Received callback for node 69f662868234569b79a20546 INFO: 172.20.0.1:40220 - "POST /node/69f662868234569b79a20546 HTTP/1.0" 202 Accepted 2026-05-04 20:46:14,351 - lava_callback - INFO - Starting async job submit for node 69f662868234569b79a20546 2026-05-04 20:46:14,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:46:14,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f662868234569b79a20546 HTTP/1.1" 200 None 2026-05-04 20:46:14,374 - lava_callback - DEBUG - Processing node 69f662868234569b79a20546: baseline-arm64-clabbe 2026-05-04 20:46:14,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f662868234569b79a20546 2026-05-04 20:46:14,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:46:14,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f662868234569b79a20546 HTTP/1.1" 200 None 2026-05-04 20:46:14,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:46:14,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0ac394a965ba0e0b7745d HTTP/1.1" 200 None 2026-05-04 20:46:14,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:46:14,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f662868234569b79a20546 HTTP/1.1" 200 None 2026-05-04 20:46:14,420 - lava_callback - ERROR - Error processing callback for node 69f662868234569b79a20546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:47:12,714 - lava_callback - INFO - Received callback for node 69f662be8234569b79a2056e INFO: 172.20.0.1:50916 - "POST /node/69f662be8234569b79a2056e HTTP/1.0" 202 Accepted 2026-05-04 20:47:12,724 - lava_callback - INFO - Starting async job submit for node 69f662be8234569b79a2056e 2026-05-04 20:47:12,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:47:12,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f662be8234569b79a2056e HTTP/1.1" 200 None 2026-05-04 20:47:12,746 - lava_callback - DEBUG - Processing node 69f662be8234569b79a2056e: baseline-arm-baylibre 2026-05-04 20:47:12,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f662be8234569b79a2056e 2026-05-04 20:47:12,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:47:12,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f662be8234569b79a2056e HTTP/1.1" 200 None 2026-05-04 20:47:12,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:47:12,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 20:47:12,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:47:12,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f662be8234569b79a2056e HTTP/1.1" 200 None 2026-05-04 20:47:12,845 - lava_callback - ERROR - Error processing callback for node 69f662be8234569b79a2056e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42202 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:48:52,821 - lava_callback - INFO - Received callback for node 69f663268234569b79a2059e INFO: 172.20.0.1:44734 - "POST /node/69f663268234569b79a2059e HTTP/1.0" 202 Accepted 2026-05-04 20:48:52,830 - lava_callback - INFO - Starting async job submit for node 69f663268234569b79a2059e 2026-05-04 20:48:52,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:48:52,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663268234569b79a2059e HTTP/1.1" 200 None 2026-05-04 20:48:52,845 - lava_callback - DEBUG - Processing node 69f663268234569b79a2059e: baseline-arm-baylibre 2026-05-04 20:48:52,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f663268234569b79a2059e 2026-05-04 20:48:52,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:48:52,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663268234569b79a2059e HTTP/1.1" 200 None 2026-05-04 20:48:52,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:48:52,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:48:52,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:48:52,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f663268234569b79a2059e HTTP/1.1" 200 None 2026-05-04 20:48:52,891 - lava_callback - ERROR - Error processing callback for node 69f663268234569b79a2059e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:49:32,693 - lava_callback - INFO - Received callback for node 69f6634a8234569b79a205ae INFO: 172.20.0.1:53040 - "POST /node/69f6634a8234569b79a205ae HTTP/1.0" 202 Accepted 2026-05-04 20:49:32,699 - lava_callback - INFO - Starting async job submit for node 69f6634a8234569b79a205ae 2026-05-04 20:49:32,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:32,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6634a8234569b79a205ae HTTP/1.1" 200 None 2026-05-04 20:49:32,714 - lava_callback - DEBUG - Processing node 69f6634a8234569b79a205ae: baseline-arm-baylibre 2026-05-04 20:49:32,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6634a8234569b79a205ae 2026-05-04 20:49:32,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:32,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6634a8234569b79a205ae HTTP/1.1" 200 None 2026-05-04 20:49:32,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:32,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:49:32,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:32,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6634a8234569b79a205ae HTTP/1.1" 200 None 2026-05-04 20:49:32,769 - lava_callback - ERROR - Error processing callback for node 69f6634a8234569b79a205ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55796 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:49:52,669 - lava_callback - INFO - Received callback for node 69f6636e8234569b79a205c1 INFO: 172.20.0.1:53324 - "POST /node/69f6636e8234569b79a205c1 HTTP/1.0" 202 Accepted 2026-05-04 20:49:52,675 - lava_callback - INFO - Starting async job submit for node 69f6636e8234569b79a205c1 2026-05-04 20:49:52,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:52,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6636e8234569b79a205c1 HTTP/1.1" 200 None 2026-05-04 20:49:52,690 - lava_callback - DEBUG - Processing node 69f6636e8234569b79a205c1: baseline-arm-baylibre 2026-05-04 20:49:52,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6636e8234569b79a205c1 2026-05-04 20:49:52,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:52,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6636e8234569b79a205c1 HTTP/1.1" 200 None 2026-05-04 20:49:52,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:52,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:49:52,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:49:52,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6636e8234569b79a205c1 HTTP/1.1" 200 None 2026-05-04 20:49:52,735 - lava_callback - ERROR - Error processing callback for node 69f6636e8234569b79a205c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43270 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:50:32,737 - lava_callback - INFO - Received callback for node 69f663918234569b79a205d2 INFO: 172.20.0.1:34048 - "POST /node/69f663918234569b79a205d2 HTTP/1.0" 202 Accepted 2026-05-04 20:50:32,742 - lava_callback - INFO - Starting async job submit for node 69f663918234569b79a205d2 2026-05-04 20:50:32,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:50:32,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663918234569b79a205d2 HTTP/1.1" 200 None 2026-05-04 20:50:32,760 - lava_callback - DEBUG - Processing node 69f663918234569b79a205d2: baseline-arm-baylibre 2026-05-04 20:50:32,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f663918234569b79a205d2 2026-05-04 20:50:32,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:50:32,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663918234569b79a205d2 HTTP/1.1" 200 None 2026-05-04 20:50:32,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:50:32,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:50:32,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:50:32,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f663918234569b79a205d2 HTTP/1.1" 200 None 2026-05-04 20:50:32,822 - lava_callback - ERROR - Error processing callback for node 69f663918234569b79a205d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56450 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:51:12,749 - lava_callback - INFO - Received callback for node 69f663b58234569b79a205e2 INFO: 172.20.0.1:35172 - "POST /node/69f663b58234569b79a205e2 HTTP/1.0" 202 Accepted 2026-05-04 20:51:12,755 - lava_callback - INFO - Starting async job submit for node 69f663b58234569b79a205e2 2026-05-04 20:51:12,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:12,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663b58234569b79a205e2 HTTP/1.1" 200 None 2026-05-04 20:51:12,770 - lava_callback - DEBUG - Processing node 69f663b58234569b79a205e2: baseline-arm-baylibre 2026-05-04 20:51:12,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f663b58234569b79a205e2 2026-05-04 20:51:12,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:12,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663b58234569b79a205e2 HTTP/1.1" 200 None 2026-05-04 20:51:12,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:12,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:51:12,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:12,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f663b58234569b79a205e2 HTTP/1.1" 200 None 2026-05-04 20:51:12,827 - lava_callback - ERROR - Error processing callback for node 69f663b58234569b79a205e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33778 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:51:53,092 - lava_callback - INFO - Received callback for node 69f663d98234569b79a205f4 INFO: 172.20.0.1:57020 - "POST /node/69f663d98234569b79a205f4 HTTP/1.0" 202 Accepted 2026-05-04 20:51:53,097 - lava_callback - INFO - Starting async job submit for node 69f663d98234569b79a205f4 2026-05-04 20:51:53,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:53,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663d98234569b79a205f4 HTTP/1.1" 200 None 2026-05-04 20:51:53,121 - lava_callback - DEBUG - Processing node 69f663d98234569b79a205f4: baseline-arm-baylibre 2026-05-04 20:51:53,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f663d98234569b79a205f4 2026-05-04 20:51:53,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:53,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663d98234569b79a205f4 HTTP/1.1" 200 None 2026-05-04 20:51:53,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:53,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:51:53,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:51:53,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f663d98234569b79a205f4 HTTP/1.1" 200 None 2026-05-04 20:51:53,173 - lava_callback - ERROR - Error processing callback for node 69f663d98234569b79a205f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52458 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:52:12,824 - lava_callback - INFO - Received callback for node 69f663fa8234569b79a20604 INFO: 172.20.0.1:33718 - "POST /node/69f663fa8234569b79a20604 HTTP/1.0" 202 Accepted 2026-05-04 20:52:12,830 - lava_callback - INFO - Starting async job submit for node 69f663fa8234569b79a20604 2026-05-04 20:52:12,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:52:12,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663fa8234569b79a20604 HTTP/1.1" 200 None 2026-05-04 20:52:12,853 - lava_callback - DEBUG - Processing node 69f663fa8234569b79a20604: baseline-arm-baylibre 2026-05-04 20:52:12,853 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f663fa8234569b79a20604 2026-05-04 20:52:12,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:52:12,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f663fa8234569b79a20604 HTTP/1.1" 200 None 2026-05-04 20:52:12,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:52:12,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 20:52:12,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:52:12,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f663fa8234569b79a20604 HTTP/1.1" 200 None 2026-05-04 20:52:12,900 - lava_callback - ERROR - Error processing callback for node 69f663fa8234569b79a20604: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57058 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:53:34,634 - lava_callback - INFO - Received callback for node 69f664448234569b79a2062a INFO: 172.20.0.1:32926 - "POST /node/69f664448234569b79a2062a HTTP/1.0" 202 Accepted 2026-05-04 20:53:34,640 - lava_callback - INFO - Starting async job submit for node 69f664448234569b79a2062a 2026-05-04 20:53:34,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:53:34,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f664448234569b79a2062a HTTP/1.1" 200 None 2026-05-04 20:53:34,655 - lava_callback - DEBUG - Processing node 69f664448234569b79a2062a: baseline-arm-clabbe 2026-05-04 20:53:34,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f664448234569b79a2062a 2026-05-04 20:53:34,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:53:34,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f664448234569b79a2062a HTTP/1.1" 200 None 2026-05-04 20:53:34,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:53:34,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 20:53:34,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:53:34,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f664448234569b79a2062a HTTP/1.1" 200 None 2026-05-04 20:53:34,702 - lava_callback - ERROR - Error processing callback for node 69f664448234569b79a2062a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:54:54,674 - lava_callback - INFO - Received callback for node 69f6648d8234569b79a2064d INFO: 172.20.0.1:54964 - "POST /node/69f6648d8234569b79a2064d HTTP/1.0" 202 Accepted 2026-05-04 20:54:54,683 - lava_callback - INFO - Starting async job submit for node 69f6648d8234569b79a2064d 2026-05-04 20:54:54,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:54:54,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6648d8234569b79a2064d HTTP/1.1" 200 None 2026-05-04 20:54:54,700 - lava_callback - DEBUG - Processing node 69f6648d8234569b79a2064d: baseline-arm-clabbe 2026-05-04 20:54:54,700 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6648d8234569b79a2064d 2026-05-04 20:54:54,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:54:54,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6648d8234569b79a2064d HTTP/1.1" 200 None 2026-05-04 20:54:54,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:54:54,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:54:54,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:54:54,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6648d8234569b79a2064d HTTP/1.1" 200 None 2026-05-04 20:54:54,755 - lava_callback - ERROR - Error processing callback for node 69f6648d8234569b79a2064d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43596 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:57:54,754 - lava_callback - INFO - Received callback for node 69f665458234569b79a206ac INFO: 172.20.0.1:39078 - "POST /node/69f665458234569b79a206ac HTTP/1.0" 202 Accepted 2026-05-04 20:57:54,760 - lava_callback - INFO - Starting async job submit for node 69f665458234569b79a206ac 2026-05-04 20:57:54,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:57:54,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665458234569b79a206ac HTTP/1.1" 200 None 2026-05-04 20:57:54,775 - lava_callback - DEBUG - Processing node 69f665458234569b79a206ac: baseline-arm-clabbe 2026-05-04 20:57:54,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f665458234569b79a206ac 2026-05-04 20:57:54,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:57:54,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665458234569b79a206ac HTTP/1.1" 200 None 2026-05-04 20:57:54,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:57:54,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 20:57:54,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:57:54,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f665458234569b79a206ac HTTP/1.1" 200 None 2026-05-04 20:57:54,830 - lava_callback - ERROR - Error processing callback for node 69f665458234569b79a206ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48170 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:58:34,714 - lava_callback - INFO - Received callback for node 69f665698234569b79a206b6 INFO: 172.20.0.1:51752 - "POST /node/69f665698234569b79a206b6 HTTP/1.0" 202 Accepted 2026-05-04 20:58:34,720 - lava_callback - INFO - Starting async job submit for node 69f665698234569b79a206b6 2026-05-04 20:58:34,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:58:34,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665698234569b79a206b6 HTTP/1.1" 200 None 2026-05-04 20:58:34,735 - lava_callback - DEBUG - Processing node 69f665698234569b79a206b6: baseline-arm-clabbe 2026-05-04 20:58:34,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f665698234569b79a206b6 2026-05-04 20:58:34,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:58:34,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665698234569b79a206b6 HTTP/1.1" 200 None 2026-05-04 20:58:34,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:58:34,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:58:34,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:58:34,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f665698234569b79a206b6 HTTP/1.1" 200 None 2026-05-04 20:58:34,786 - lava_callback - ERROR - Error processing callback for node 69f665698234569b79a206b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:59:14,772 - lava_callback - INFO - Received callback for node 69f6658d8234569b79a206ce INFO: 172.20.0.1:34154 - "POST /node/69f6658d8234569b79a206ce HTTP/1.0" 202 Accepted 2026-05-04 20:59:14,777 - lava_callback - INFO - Starting async job submit for node 69f6658d8234569b79a206ce 2026-05-04 20:59:14,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:14,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6658d8234569b79a206ce HTTP/1.1" 200 None 2026-05-04 20:59:14,792 - lava_callback - DEBUG - Processing node 69f6658d8234569b79a206ce: baseline-arm-clabbe 2026-05-04 20:59:14,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6658d8234569b79a206ce 2026-05-04 20:59:14,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:14,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6658d8234569b79a206ce HTTP/1.1" 200 None 2026-05-04 20:59:14,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:14,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 20:59:14,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:14,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6658d8234569b79a206ce HTTP/1.1" 200 None 2026-05-04 20:59:14,847 - lava_callback - ERROR - Error processing callback for node 69f6658d8234569b79a206ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44450 - "GET / HTTP/1.0" 200 OK 2026-05-04 20:59:34,752 - lava_callback - INFO - Received callback for node 69f665b28234569b79a206e0 INFO: 172.20.0.1:51898 - "POST /node/69f665b28234569b79a206e0 HTTP/1.0" 202 Accepted 2026-05-04 20:59:34,758 - lava_callback - INFO - Starting async job submit for node 69f665b28234569b79a206e0 2026-05-04 20:59:34,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:34,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665b28234569b79a206e0 HTTP/1.1" 200 None 2026-05-04 20:59:34,780 - lava_callback - DEBUG - Processing node 69f665b28234569b79a206e0: baseline-arm-clabbe 2026-05-04 20:59:34,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f665b28234569b79a206e0 2026-05-04 20:59:34,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:34,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665b28234569b79a206e0 HTTP/1.1" 200 None 2026-05-04 20:59:34,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:34,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 20:59:34,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 20:59:34,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f665b28234569b79a206e0 HTTP/1.1" 200 None 2026-05-04 20:59:34,848 - lava_callback - ERROR - Error processing callback for node 69f665b28234569b79a206e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46126 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:00:14,925 - lava_callback - INFO - Received callback for node 69f665d88234569b79a206ef INFO: 172.20.0.1:47168 - "POST /node/69f665d88234569b79a206ef HTTP/1.0" 202 Accepted 2026-05-04 21:00:14,930 - lava_callback - INFO - Starting async job submit for node 69f665d88234569b79a206ef 2026-05-04 21:00:14,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:14,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665d88234569b79a206ef HTTP/1.1" 200 None 2026-05-04 21:00:14,945 - lava_callback - DEBUG - Processing node 69f665d88234569b79a206ef: baseline-arm-clabbe 2026-05-04 21:00:14,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f665d88234569b79a206ef 2026-05-04 21:00:14,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:14,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665d88234569b79a206ef HTTP/1.1" 200 None 2026-05-04 21:00:14,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:14,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 21:00:14,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:14,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f665d88234569b79a206ef HTTP/1.1" 200 None 2026-05-04 21:00:14,994 - lava_callback - ERROR - Error processing callback for node 69f665d88234569b79a206ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32930 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:00:54,864 - lava_callback - INFO - Received callback for node 69f665fc8234569b79a20700 INFO: 172.20.0.1:36126 - "POST /node/69f665fc8234569b79a20700 HTTP/1.0" 202 Accepted 2026-05-04 21:00:54,870 - lava_callback - INFO - Starting async job submit for node 69f665fc8234569b79a20700 2026-05-04 21:00:54,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:54,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665fc8234569b79a20700 HTTP/1.1" 200 None 2026-05-04 21:00:54,887 - lava_callback - DEBUG - Processing node 69f665fc8234569b79a20700: baseline-arm-clabbe 2026-05-04 21:00:54,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f665fc8234569b79a20700 2026-05-04 21:00:54,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:54,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f665fc8234569b79a20700 HTTP/1.1" 200 None 2026-05-04 21:00:54,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:54,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:00:54,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:00:54,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f665fc8234569b79a20700 HTTP/1.1" 200 None 2026-05-04 21:00:54,943 - lava_callback - ERROR - Error processing callback for node 69f665fc8234569b79a20700: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33094 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:02:04,194 - lava_callback - INFO - Received callback for node 69f8f3740573a8210e131955 INFO: 172.20.0.1:49842 - "POST /node/69f8f3740573a8210e131955 HTTP/1.0" 202 Accepted 2026-05-04 21:02:04,201 - lava_callback - INFO - Starting async job submit for node 69f8f3740573a8210e131955 2026-05-04 21:02:04,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:02:04,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f3740573a8210e131955 HTTP/1.1" 200 None 2026-05-04 21:02:04,243 - lava_callback - DEBUG - Processing node 69f8f3740573a8210e131955: baseline-nfs-arm64 2026-05-04 21:02:04,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 21:02:04,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 21:02:04,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8f3740573a8210e131955/log.txt.gz 2026-05-04 21:02:05,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 21:02:05,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 21:02:05,374 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8f3740573a8210e131955/lava-logs.yaml 2026-05-04 21:02:05,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-04 21:02:05,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-04 21:02:05,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69f8f3740573a8210e131955/lava_callback.json.gz 2026-05-04 21:02:05,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:02:05,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8f3740573a8210e131955 HTTP/1.1" 200 None 2026-05-04 21:02:05,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:02:05,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f8c6760573a8210e12ccd7 HTTP/1.1" 200 None 2026-05-04 21:02:05,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:02:05,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f8f3740573a8210e131955 HTTP/1.1" 200 None 2026-05-04 21:02:05,682 - lava_callback - INFO - Completed processing callback for node 69f8f3740573a8210e131955 INFO: 172.20.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50936 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:02:28,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:02:28,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59402 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:03:55,043 - lava_callback - INFO - Received callback for node 69f666b68234569b79a20752 INFO: 172.20.0.1:47880 - "POST /node/69f666b68234569b79a20752 HTTP/1.0" 202 Accepted 2026-05-04 21:03:55,052 - lava_callback - INFO - Starting async job submit for node 69f666b68234569b79a20752 2026-05-04 21:03:55,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:03:55,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f666b68234569b79a20752 HTTP/1.1" 200 None 2026-05-04 21:03:55,074 - lava_callback - DEBUG - Processing node 69f666b68234569b79a20752: baseline-arm-clabbe 2026-05-04 21:03:55,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f666b68234569b79a20752 2026-05-04 21:03:55,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:03:55,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f666b68234569b79a20752 HTTP/1.1" 200 None 2026-05-04 21:03:55,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:03:55,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b3718cb8354ccaa5e9d2 HTTP/1.1" 200 None 2026-05-04 21:03:55,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:03:55,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f666b68234569b79a20752 HTTP/1.1" 200 None 2026-05-04 21:03:55,135 - lava_callback - ERROR - Error processing callback for node 69f666b68234569b79a20752: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50302 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:04:35,042 - lava_callback - INFO - Received callback for node 69f666da8234569b79a20763 INFO: 172.20.0.1:47618 - "POST /node/69f666da8234569b79a20763 HTTP/1.0" 202 Accepted 2026-05-04 21:04:35,054 - lava_callback - INFO - Starting async job submit for node 69f666da8234569b79a20763 2026-05-04 21:04:35,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:04:35,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f666da8234569b79a20763 HTTP/1.1" 200 None 2026-05-04 21:04:35,076 - lava_callback - DEBUG - Processing node 69f666da8234569b79a20763: baseline-arm-clabbe 2026-05-04 21:04:35,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f666da8234569b79a20763 2026-05-04 21:04:35,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:04:35,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f666da8234569b79a20763 HTTP/1.1" 200 None 2026-05-04 21:04:35,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:04:35,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:04:35,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:04:35,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f666da8234569b79a20763 HTTP/1.1" 200 None 2026-05-04 21:04:35,122 - lava_callback - ERROR - Error processing callback for node 69f666da8234569b79a20763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37662 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48662 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:06:35,160 - lava_callback - INFO - Received callback for node 69f667448234569b79a20790 INFO: 172.20.0.1:35100 - "POST /node/69f667448234569b79a20790 HTTP/1.0" 202 Accepted 2026-05-04 21:06:35,166 - lava_callback - INFO - Starting async job submit for node 69f667448234569b79a20790 2026-05-04 21:06:35,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:06:35,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f667448234569b79a20790 HTTP/1.1" 200 None 2026-05-04 21:06:35,205 - lava_callback - DEBUG - Processing node 69f667448234569b79a20790: baseline-arm-clabbe 2026-05-04 21:06:35,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f667448234569b79a20790 2026-05-04 21:06:35,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:06:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f667448234569b79a20790 HTTP/1.1" 200 None 2026-05-04 21:06:35,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:06:35,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:06:35,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:06:35,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f667448234569b79a20790 HTTP/1.1" 200 None 2026-05-04 21:06:35,259 - lava_callback - ERROR - Error processing callback for node 69f667448234569b79a20790: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46638 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:08:55,190 - lava_callback - INFO - Received callback for node 69f667d68234569b79a207cd INFO: 172.20.0.1:35218 - "POST /node/69f667d68234569b79a207cd HTTP/1.0" 202 Accepted 2026-05-04 21:08:55,196 - lava_callback - INFO - Starting async job submit for node 69f667d68234569b79a207cd 2026-05-04 21:08:55,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:08:55,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f667d68234569b79a207cd HTTP/1.1" 200 None 2026-05-04 21:08:55,212 - lava_callback - DEBUG - Processing node 69f667d68234569b79a207cd: baseline-arm-clabbe 2026-05-04 21:08:55,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f667d68234569b79a207cd 2026-05-04 21:08:55,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:08:55,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f667d68234569b79a207cd HTTP/1.1" 200 None 2026-05-04 21:08:55,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:08:55,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:08:55,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:08:55,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f667d68234569b79a207cd HTTP/1.1" 200 None 2026-05-04 21:08:55,270 - lava_callback - ERROR - Error processing callback for node 69f667d68234569b79a207cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47170 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:09:55,225 - lava_callback - INFO - Received callback for node 69f6681c8234569b79a207ea INFO: 172.20.0.1:39922 - "POST /node/69f6681c8234569b79a207ea HTTP/1.0" 202 Accepted 2026-05-04 21:09:55,231 - lava_callback - INFO - Starting async job submit for node 69f6681c8234569b79a207ea 2026-05-04 21:09:55,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:09:55,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6681c8234569b79a207ea HTTP/1.1" 200 None 2026-05-04 21:09:55,262 - lava_callback - DEBUG - Processing node 69f6681c8234569b79a207ea: baseline-arm-clabbe 2026-05-04 21:09:55,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6681c8234569b79a207ea 2026-05-04 21:09:55,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:09:55,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6681c8234569b79a207ea HTTP/1.1" 200 None 2026-05-04 21:09:55,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:09:55,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:09:55,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:09:55,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6681c8234569b79a207ea HTTP/1.1" 200 None 2026-05-04 21:09:55,314 - lava_callback - ERROR - Error processing callback for node 69f6681c8234569b79a207ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40710 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:10:35,179 - lava_callback - INFO - Received callback for node 69f668418234569b79a207fb INFO: 172.20.0.1:38504 - "POST /node/69f668418234569b79a207fb HTTP/1.0" 202 Accepted 2026-05-04 21:10:35,185 - lava_callback - INFO - Starting async job submit for node 69f668418234569b79a207fb 2026-05-04 21:10:35,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:10:35,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f668418234569b79a207fb HTTP/1.1" 200 None 2026-05-04 21:10:35,205 - lava_callback - DEBUG - Processing node 69f668418234569b79a207fb: baseline-arm-clabbe 2026-05-04 21:10:35,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f668418234569b79a207fb 2026-05-04 21:10:35,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:10:35,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f668418234569b79a207fb HTTP/1.1" 200 None 2026-05-04 21:10:35,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:10:35,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:10:35,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:10:35,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f668418234569b79a207fb HTTP/1.1" 200 None 2026-05-04 21:10:35,264 - lava_callback - ERROR - Error processing callback for node 69f668418234569b79a207fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59848 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:16:35,539 - lava_callback - INFO - Received callback for node 69f669a78234569b79a208b9 INFO: 172.20.0.1:43696 - "POST /node/69f669a78234569b79a208b9 HTTP/1.0" 202 Accepted 2026-05-04 21:16:35,544 - lava_callback - INFO - Starting async job submit for node 69f669a78234569b79a208b9 2026-05-04 21:16:35,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:16:35,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f669a78234569b79a208b9 HTTP/1.1" 200 None 2026-05-04 21:16:35,563 - lava_callback - DEBUG - Processing node 69f669a78234569b79a208b9: baseline-arm-clabbe 2026-05-04 21:16:35,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f669a78234569b79a208b9 2026-05-04 21:16:35,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:16:35,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f669a78234569b79a208b9 HTTP/1.1" 200 None 2026-05-04 21:16:35,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:16:35,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:16:35,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:16:35,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f669a78234569b79a208b9 HTTP/1.1" 200 None 2026-05-04 21:16:35,612 - lava_callback - ERROR - Error processing callback for node 69f669a78234569b79a208b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53366 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:17:14,285 - lava_callback - INFO - Received callback for node 69f669d18234569b79a208cc INFO: 172.20.0.1:56286 - "POST /node/69f669d18234569b79a208cc HTTP/1.0" 202 Accepted 2026-05-04 21:17:14,290 - lava_callback - INFO - Starting async job submit for node 69f669d18234569b79a208cc 2026-05-04 21:17:14,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:17:14,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f669d18234569b79a208cc HTTP/1.1" 200 None 2026-05-04 21:17:14,306 - lava_callback - DEBUG - Processing node 69f669d18234569b79a208cc: baseline-arm64-baylibre 2026-05-04 21:17:14,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f669d18234569b79a208cc 2026-05-04 21:17:14,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:17:14,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f669d18234569b79a208cc HTTP/1.1" 200 None 2026-05-04 21:17:14,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:17:14,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:17:14,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:17:14,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f669d18234569b79a208cc HTTP/1.1" 200 None 2026-05-04 21:17:14,351 - lava_callback - ERROR - Error processing callback for node 69f669d18234569b79a208cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38952 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:18:34,487 - lava_callback - INFO - Received callback for node 69f66a198234569b79a208f6 INFO: 172.20.0.1:48220 - "POST /node/69f66a198234569b79a208f6 HTTP/1.0" 202 Accepted 2026-05-04 21:18:34,493 - lava_callback - INFO - Starting async job submit for node 69f66a198234569b79a208f6 2026-05-04 21:18:34,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:18:34,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66a198234569b79a208f6 HTTP/1.1" 200 None 2026-05-04 21:18:34,529 - lava_callback - DEBUG - Processing node 69f66a198234569b79a208f6: baseline-arm64-baylibre 2026-05-04 21:18:34,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66a198234569b79a208f6 2026-05-04 21:18:34,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:18:34,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66a198234569b79a208f6 HTTP/1.1" 200 None 2026-05-04 21:18:34,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:18:34,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:18:34,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:18:34,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66a198234569b79a208f6 HTTP/1.1" 200 None 2026-05-04 21:18:34,604 - lava_callback - ERROR - Error processing callback for node 69f66a198234569b79a208f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36452 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:19:34,352 - lava_callback - INFO - Received callback for node 69f66a618234569b79a20916 INFO: 172.20.0.1:59592 - "POST /node/69f66a618234569b79a20916 HTTP/1.0" 202 Accepted 2026-05-04 21:19:34,358 - lava_callback - INFO - Starting async job submit for node 69f66a618234569b79a20916 2026-05-04 21:19:34,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:19:34,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66a618234569b79a20916 HTTP/1.1" 200 None 2026-05-04 21:19:34,374 - lava_callback - DEBUG - Processing node 69f66a618234569b79a20916: baseline-arm64-baylibre 2026-05-04 21:19:34,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66a618234569b79a20916 2026-05-04 21:19:34,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:19:34,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66a618234569b79a20916 HTTP/1.1" 200 None 2026-05-04 21:19:34,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:19:34,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:19:34,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:19:34,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66a618234569b79a20916 HTTP/1.1" 200 None 2026-05-04 21:19:34,424 - lava_callback - ERROR - Error processing callback for node 69f66a618234569b79a20916: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48326 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:21:34,516 - lava_callback - INFO - Received callback for node 69f66ad08234569b79a20953 INFO: 172.20.0.1:57258 - "POST /node/69f66ad08234569b79a20953 HTTP/1.0" 202 Accepted 2026-05-04 21:21:34,521 - lava_callback - INFO - Starting async job submit for node 69f66ad08234569b79a20953 2026-05-04 21:21:34,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:21:34,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66ad08234569b79a20953 HTTP/1.1" 200 None 2026-05-04 21:21:34,537 - lava_callback - DEBUG - Processing node 69f66ad08234569b79a20953: baseline-arm64-baylibre 2026-05-04 21:21:34,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66ad08234569b79a20953 2026-05-04 21:21:34,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:21:34,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66ad08234569b79a20953 HTTP/1.1" 200 None 2026-05-04 21:21:34,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:21:34,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:21:34,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:21:34,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66ad08234569b79a20953 HTTP/1.1" 200 None 2026-05-04 21:21:34,581 - lava_callback - ERROR - Error processing callback for node 69f66ad08234569b79a20953: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40954 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:22:34,537 - lava_callback - INFO - Received callback for node 69f66b188234569b79a20979 INFO: 172.20.0.1:48526 - "POST /node/69f66b188234569b79a20979 HTTP/1.0" 202 Accepted 2026-05-04 21:22:34,543 - lava_callback - INFO - Starting async job submit for node 69f66b188234569b79a20979 2026-05-04 21:22:34,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:22:34,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66b188234569b79a20979 HTTP/1.1" 200 None 2026-05-04 21:22:34,558 - lava_callback - DEBUG - Processing node 69f66b188234569b79a20979: baseline-arm64-baylibre 2026-05-04 21:22:34,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66b188234569b79a20979 2026-05-04 21:22:34,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:22:34,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66b188234569b79a20979 HTTP/1.1" 200 None 2026-05-04 21:22:34,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:22:34,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:22:34,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:22:34,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66b188234569b79a20979 HTTP/1.1" 200 None 2026-05-04 21:22:34,604 - lava_callback - ERROR - Error processing callback for node 69f66b188234569b79a20979: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57474 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:23:54,582 - lava_callback - INFO - Received callback for node 69f66b608234569b79a209ad INFO: 172.20.0.1:55324 - "POST /node/69f66b608234569b79a209ad HTTP/1.0" 202 Accepted 2026-05-04 21:23:54,588 - lava_callback - INFO - Starting async job submit for node 69f66b608234569b79a209ad 2026-05-04 21:23:54,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:23:54,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66b608234569b79a209ad HTTP/1.1" 200 None 2026-05-04 21:23:54,602 - lava_callback - DEBUG - Processing node 69f66b608234569b79a209ad: baseline-arm64-baylibre 2026-05-04 21:23:54,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66b608234569b79a209ad 2026-05-04 21:23:54,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:23:54,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66b608234569b79a209ad HTTP/1.1" 200 None 2026-05-04 21:23:54,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:23:54,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:23:54,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:23:54,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66b608234569b79a209ad HTTP/1.1" 200 None 2026-05-04 21:23:54,656 - lava_callback - ERROR - Error processing callback for node 69f66b608234569b79a209ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:25:55,834 - lava_callback - INFO - Received callback for node 69f66bd38234569b79a209e3 INFO: 172.20.0.1:49548 - "POST /node/69f66bd38234569b79a209e3 HTTP/1.0" 202 Accepted 2026-05-04 21:25:55,839 - lava_callback - INFO - Starting async job submit for node 69f66bd38234569b79a209e3 2026-05-04 21:25:55,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:25:55,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66bd38234569b79a209e3 HTTP/1.1" 200 None 2026-05-04 21:25:55,867 - lava_callback - DEBUG - Processing node 69f66bd38234569b79a209e3: baseline-arm64-clabbe 2026-05-04 21:25:55,868 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66bd38234569b79a209e3 2026-05-04 21:25:55,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:25:55,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66bd38234569b79a209e3 HTTP/1.1" 200 None 2026-05-04 21:25:55,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:25:55,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:25:55,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:25:55,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66bd38234569b79a209e3 HTTP/1.1" 200 None 2026-05-04 21:25:55,917 - lava_callback - ERROR - Error processing callback for node 69f66bd38234569b79a209e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45280 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:26:55,847 - lava_callback - INFO - Received callback for node 69f66c1b8234569b79a20a0f INFO: 172.20.0.1:43786 - "POST /node/69f66c1b8234569b79a20a0f HTTP/1.0" 202 Accepted 2026-05-04 21:26:55,853 - lava_callback - INFO - Starting async job submit for node 69f66c1b8234569b79a20a0f 2026-05-04 21:26:55,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:26:55,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66c1b8234569b79a20a0f HTTP/1.1" 200 None 2026-05-04 21:26:55,867 - lava_callback - DEBUG - Processing node 69f66c1b8234569b79a20a0f: baseline-arm64-clabbe 2026-05-04 21:26:55,868 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66c1b8234569b79a20a0f 2026-05-04 21:26:55,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:26:55,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66c1b8234569b79a20a0f HTTP/1.1" 200 None 2026-05-04 21:26:55,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:26:55,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:26:55,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:26:55,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66c1b8234569b79a20a0f HTTP/1.1" 200 None 2026-05-04 21:26:55,925 - lava_callback - ERROR - Error processing callback for node 69f66c1b8234569b79a20a0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49572 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:28:15,893 - lava_callback - INFO - Received callback for node 69f66c648234569b79a20a2c INFO: 172.20.0.1:49584 - "POST /node/69f66c648234569b79a20a2c HTTP/1.0" 202 Accepted 2026-05-04 21:28:15,899 - lava_callback - INFO - Starting async job submit for node 69f66c648234569b79a20a2c 2026-05-04 21:28:15,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:28:15,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66c648234569b79a20a2c HTTP/1.1" 200 None 2026-05-04 21:28:15,913 - lava_callback - DEBUG - Processing node 69f66c648234569b79a20a2c: baseline-arm64-clabbe 2026-05-04 21:28:15,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66c648234569b79a20a2c 2026-05-04 21:28:15,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:28:15,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66c648234569b79a20a2c HTTP/1.1" 200 None 2026-05-04 21:28:15,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:28:15,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:28:15,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:28:15,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66c648234569b79a20a2c HTTP/1.1" 200 None 2026-05-04 21:28:15,971 - lava_callback - ERROR - Error processing callback for node 69f66c648234569b79a20a2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57616 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:29:35,976 - lava_callback - INFO - Received callback for node 69f66cac8234569b79a20a5d INFO: 172.20.0.1:39618 - "POST /node/69f66cac8234569b79a20a5d HTTP/1.0" 202 Accepted 2026-05-04 21:29:35,981 - lava_callback - INFO - Starting async job submit for node 69f66cac8234569b79a20a5d 2026-05-04 21:29:35,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:29:35,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66cac8234569b79a20a5d HTTP/1.1" 200 None 2026-05-04 21:29:35,997 - lava_callback - DEBUG - Processing node 69f66cac8234569b79a20a5d: baseline-arm64-clabbe 2026-05-04 21:29:35,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66cac8234569b79a20a5d 2026-05-04 21:29:35,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:29:36,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66cac8234569b79a20a5d HTTP/1.1" 200 None 2026-05-04 21:29:36,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:29:36,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:29:36,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:29:36,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66cac8234569b79a20a5d HTTP/1.1" 200 None 2026-05-04 21:29:36,114 - lava_callback - ERROR - Error processing callback for node 69f66cac8234569b79a20a5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50276 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:31:56,072 - lava_callback - INFO - Received callback for node 69f66d3d8234569b79a20aa9 INFO: 172.20.0.1:47202 - "POST /node/69f66d3d8234569b79a20aa9 HTTP/1.0" 202 Accepted 2026-05-04 21:31:56,077 - lava_callback - INFO - Starting async job submit for node 69f66d3d8234569b79a20aa9 2026-05-04 21:31:56,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:31:56,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66d3d8234569b79a20aa9 HTTP/1.1" 200 None 2026-05-04 21:31:56,093 - lava_callback - DEBUG - Processing node 69f66d3d8234569b79a20aa9: baseline-arm64-clabbe 2026-05-04 21:31:56,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66d3d8234569b79a20aa9 2026-05-04 21:31:56,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:31:56,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66d3d8234569b79a20aa9 HTTP/1.1" 200 None 2026-05-04 21:31:56,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:31:56,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:31:56,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:31:56,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66d3d8234569b79a20aa9 HTTP/1.1" 200 None 2026-05-04 21:31:56,141 - lava_callback - ERROR - Error processing callback for node 69f66d3d8234569b79a20aa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32994 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:33:16,150 - lava_callback - INFO - Received callback for node 69f66d868234569b79a20ac4 INFO: 172.20.0.1:33010 - "POST /node/69f66d868234569b79a20ac4 HTTP/1.0" 202 Accepted 2026-05-04 21:33:16,156 - lava_callback - INFO - Starting async job submit for node 69f66d868234569b79a20ac4 2026-05-04 21:33:16,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:33:16,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66d868234569b79a20ac4 HTTP/1.1" 200 None 2026-05-04 21:33:16,177 - lava_callback - DEBUG - Processing node 69f66d868234569b79a20ac4: baseline-arm64-clabbe 2026-05-04 21:33:16,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66d868234569b79a20ac4 2026-05-04 21:33:16,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:33:16,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66d868234569b79a20ac4 HTTP/1.1" 200 None 2026-05-04 21:33:16,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:33:16,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5b37d8cb8354ccaa5e9e1 HTTP/1.1" 200 None 2026-05-04 21:33:16,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:33:16,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66d868234569b79a20ac4 HTTP/1.1" 200 None 2026-05-04 21:33:16,239 - lava_callback - ERROR - Error processing callback for node 69f66d868234569b79a20ac4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:34:36,197 - lava_callback - INFO - Received callback for node 69f66de58234569b79a20af4 INFO: 172.20.0.1:40160 - "POST /node/69f66de58234569b79a20af4 HTTP/1.0" 202 Accepted 2026-05-04 21:34:36,203 - lava_callback - INFO - Starting async job submit for node 69f66de58234569b79a20af4 2026-05-04 21:34:36,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:34:36,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66de58234569b79a20af4 HTTP/1.1" 200 None 2026-05-04 21:34:36,218 - lava_callback - DEBUG - Processing node 69f66de58234569b79a20af4: baseline-arm-clabbe 2026-05-04 21:34:36,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66de58234569b79a20af4 2026-05-04 21:34:36,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:34:36,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66de58234569b79a20af4 HTTP/1.1" 200 None 2026-05-04 21:34:36,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:34:36,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:34:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:34:36,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66de58234569b79a20af4 HTTP/1.1" 200 None 2026-05-04 21:34:36,277 - lava_callback - ERROR - Error processing callback for node 69f66de58234569b79a20af4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40366 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:35:16,299 - lava_callback - INFO - Received callback for node 69f66e098234569b79a20b03 INFO: 172.20.0.1:40374 - "POST /node/69f66e098234569b79a20b03 HTTP/1.0" 202 Accepted 2026-05-04 21:35:16,304 - lava_callback - INFO - Starting async job submit for node 69f66e098234569b79a20b03 2026-05-04 21:35:16,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66e098234569b79a20b03 HTTP/1.1" 200 None 2026-05-04 21:35:16,320 - lava_callback - DEBUG - Processing node 69f66e098234569b79a20b03: baseline-arm-clabbe 2026-05-04 21:35:16,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66e098234569b79a20b03 2026-05-04 21:35:16,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:16,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66e098234569b79a20b03 HTTP/1.1" 200 None 2026-05-04 21:35:16,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:16,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:35:16,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:16,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66e098234569b79a20b03 HTTP/1.1" 200 None 2026-05-04 21:35:16,366 - lava_callback - ERROR - Error processing callback for node 69f66e098234569b79a20b03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58268 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:35:56,279 - lava_callback - INFO - Received callback for node 69f66e2e8234569b79a20b18 INFO: 172.20.0.1:59712 - "POST /node/69f66e2e8234569b79a20b18 HTTP/1.0" 202 Accepted 2026-05-04 21:35:56,286 - lava_callback - INFO - Starting async job submit for node 69f66e2e8234569b79a20b18 2026-05-04 21:35:56,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:56,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66e2e8234569b79a20b18 HTTP/1.1" 200 None 2026-05-04 21:35:56,301 - lava_callback - DEBUG - Processing node 69f66e2e8234569b79a20b18: baseline-arm-clabbe 2026-05-04 21:35:56,301 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66e2e8234569b79a20b18 2026-05-04 21:35:56,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:56,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66e2e8234569b79a20b18 HTTP/1.1" 200 None 2026-05-04 21:35:56,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:56,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:35:56,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:35:56,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66e2e8234569b79a20b18 HTTP/1.1" 200 None 2026-05-04 21:35:56,350 - lava_callback - ERROR - Error processing callback for node 69f66e2e8234569b79a20b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37404 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:36:36,208 - lava_callback - INFO - Received callback for node 69f66e528234569b79a20b22 INFO: 172.20.0.1:35780 - "POST /node/69f66e528234569b79a20b22 HTTP/1.0" 202 Accepted 2026-05-04 21:36:36,217 - lava_callback - INFO - Starting async job submit for node 69f66e528234569b79a20b22 2026-05-04 21:36:36,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:36:36,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66e528234569b79a20b22 HTTP/1.1" 200 None 2026-05-04 21:36:36,232 - lava_callback - DEBUG - Processing node 69f66e528234569b79a20b22: baseline-arm-clabbe 2026-05-04 21:36:36,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66e528234569b79a20b22 2026-05-04 21:36:36,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:36:36,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66e528234569b79a20b22 HTTP/1.1" 200 None 2026-05-04 21:36:36,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:36:36,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:36:36,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:36:36,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66e528234569b79a20b22 HTTP/1.1" 200 None 2026-05-04 21:36:36,305 - lava_callback - ERROR - Error processing callback for node 69f66e528234569b79a20b22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45436 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:39:16,507 - lava_callback - INFO - Received callback for node 69f66f008234569b79a20b5d INFO: 172.20.0.1:45448 - "POST /node/69f66f008234569b79a20b5d HTTP/1.0" 202 Accepted 2026-05-04 21:39:16,515 - lava_callback - INFO - Starting async job submit for node 69f66f008234569b79a20b5d 2026-05-04 21:39:16,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:45454 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:39:16,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66f008234569b79a20b5d HTTP/1.1" 200 None 2026-05-04 21:39:16,534 - lava_callback - DEBUG - Processing node 69f66f008234569b79a20b5d: baseline-arm-clabbe 2026-05-04 21:39:16,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66f008234569b79a20b5d 2026-05-04 21:39:16,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:39:16,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66f008234569b79a20b5d HTTP/1.1" 200 None 2026-05-04 21:39:16,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:39:16,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310a393551c40ae2f3bf9 HTTP/1.1" 200 None 2026-05-04 21:39:16,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:39:16,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66f008234569b79a20b5d HTTP/1.1" 200 None 2026-05-04 21:39:16,579 - lava_callback - ERROR - Error processing callback for node 69f66f008234569b79a20b5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:41:55,675 - lava_callback - INFO - Received callback for node 69f66f9d8234569b79a20b70 INFO: 172.20.0.1:60824 - "POST /node/69f66f9d8234569b79a20b70 HTTP/1.0" 202 Accepted 2026-05-04 21:41:55,680 - lava_callback - INFO - Starting async job submit for node 69f66f9d8234569b79a20b70 2026-05-04 21:41:55,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:41:55,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66f9d8234569b79a20b70 HTTP/1.1" 200 None 2026-05-04 21:41:55,696 - lava_callback - DEBUG - Processing node 69f66f9d8234569b79a20b70: baseline-arm64-baylibre 2026-05-04 21:41:55,696 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f66f9d8234569b79a20b70 2026-05-04 21:41:55,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:41:55,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f66f9d8234569b79a20b70 HTTP/1.1" 200 None 2026-05-04 21:41:55,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:41:55,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:41:55,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:41:55,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f66f9d8234569b79a20b70 HTTP/1.1" 200 None 2026-05-04 21:41:55,758 - lava_callback - ERROR - Error processing callback for node 69f66f9d8234569b79a20b70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48252 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:43:55,692 - lava_callback - INFO - Received callback for node 69f670098234569b79a20b94 INFO: 172.20.0.1:44936 - "POST /node/69f670098234569b79a20b94 HTTP/1.0" 202 Accepted 2026-05-04 21:43:55,698 - lava_callback - INFO - Starting async job submit for node 69f670098234569b79a20b94 2026-05-04 21:43:55,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:43:55,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f670098234569b79a20b94 HTTP/1.1" 200 None 2026-05-04 21:43:55,713 - lava_callback - DEBUG - Processing node 69f670098234569b79a20b94: baseline-arm64-baylibre 2026-05-04 21:43:55,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f670098234569b79a20b94 2026-05-04 21:43:55,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:43:55,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f670098234569b79a20b94 HTTP/1.1" 200 None 2026-05-04 21:43:55,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:43:55,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:43:55,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:43:55,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f670098234569b79a20b94 HTTP/1.1" 200 None 2026-05-04 21:43:55,770 - lava_callback - ERROR - Error processing callback for node 69f670098234569b79a20b94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46008 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:44:55,664 - lava_callback - INFO - Received callback for node 69f670508234569b79a20bbe INFO: 172.20.0.1:32890 - "POST /node/69f670508234569b79a20bbe HTTP/1.0" 202 Accepted 2026-05-04 21:44:55,670 - lava_callback - INFO - Starting async job submit for node 69f670508234569b79a20bbe 2026-05-04 21:44:55,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:44:55,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f670508234569b79a20bbe HTTP/1.1" 200 None 2026-05-04 21:44:55,685 - lava_callback - DEBUG - Processing node 69f670508234569b79a20bbe: baseline-arm64-baylibre 2026-05-04 21:44:55,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f670508234569b79a20bbe 2026-05-04 21:44:55,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:44:55,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f670508234569b79a20bbe HTTP/1.1" 200 None 2026-05-04 21:44:55,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:44:55,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:44:55,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:44:55,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f670508234569b79a20bbe HTTP/1.1" 200 None 2026-05-04 21:44:55,730 - lava_callback - ERROR - Error processing callback for node 69f670508234569b79a20bbe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54388 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:46:15,798 - lava_callback - INFO - Received callback for node 69f670988234569b79a20bdf INFO: 172.20.0.1:54392 - "POST /node/69f670988234569b79a20bdf HTTP/1.0" 202 Accepted 2026-05-04 21:46:15,804 - lava_callback - INFO - Starting async job submit for node 69f670988234569b79a20bdf 2026-05-04 21:46:15,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:46:15,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f670988234569b79a20bdf HTTP/1.1" 200 None 2026-05-04 21:46:15,819 - lava_callback - DEBUG - Processing node 69f670988234569b79a20bdf: baseline-arm64-baylibre 2026-05-04 21:46:15,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f670988234569b79a20bdf 2026-05-04 21:46:15,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:46:15,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f670988234569b79a20bdf HTTP/1.1" 200 None 2026-05-04 21:46:15,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:46:15,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:46:15,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:46:15,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f670988234569b79a20bdf HTTP/1.1" 200 None 2026-05-04 21:46:15,870 - lava_callback - ERROR - Error processing callback for node 69f670988234569b79a20bdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58266 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:49:15,968 - lava_callback - INFO - Received callback for node 69f671568234569b79a20c0b INFO: 172.20.0.1:58282 - "POST /node/69f671568234569b79a20c0b HTTP/1.0" 202 Accepted 2026-05-04 21:49:15,974 - lava_callback - INFO - Starting async job submit for node 69f671568234569b79a20c0b 2026-05-04 21:49:15,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:49:15,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f671568234569b79a20c0b HTTP/1.1" 200 None 2026-05-04 21:49:15,994 - lava_callback - DEBUG - Processing node 69f671568234569b79a20c0b: baseline-arm64-baylibre 2026-05-04 21:49:15,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f671568234569b79a20c0b 2026-05-04 21:49:15,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:49:16,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f671568234569b79a20c0b HTTP/1.1" 200 None 2026-05-04 21:49:16,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:49:16,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:49:16,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:49:16,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f671568234569b79a20c0b HTTP/1.1" 200 None 2026-05-04 21:49:16,042 - lava_callback - ERROR - Error processing callback for node 69f671568234569b79a20c0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58522 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:50:36,009 - lava_callback - INFO - Received callback for node 69f671a28234569b79a20c38 INFO: 172.20.0.1:57092 - "POST /node/69f671a28234569b79a20c38 HTTP/1.0" 202 Accepted 2026-05-04 21:50:36,014 - lava_callback - INFO - Starting async job submit for node 69f671a28234569b79a20c38 2026-05-04 21:50:36,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:50:36,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f671a28234569b79a20c38 HTTP/1.1" 200 None 2026-05-04 21:50:36,037 - lava_callback - DEBUG - Processing node 69f671a28234569b79a20c38: baseline-arm64-baylibre 2026-05-04 21:50:36,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f671a28234569b79a20c38 2026-05-04 21:50:36,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:50:36,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f671a28234569b79a20c38 HTTP/1.1" 200 None 2026-05-04 21:50:36,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:50:36,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:50:36,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:50:36,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f671a28234569b79a20c38 HTTP/1.1" 200 None 2026-05-04 21:50:36,095 - lava_callback - ERROR - Error processing callback for node 69f671a28234569b79a20c38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36486 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:51:56,091 - lava_callback - INFO - Received callback for node 69f671ee8234569b79a20c6a INFO: 172.20.0.1:51486 - "POST /node/69f671ee8234569b79a20c6a HTTP/1.0" 202 Accepted 2026-05-04 21:51:56,097 - lava_callback - INFO - Starting async job submit for node 69f671ee8234569b79a20c6a 2026-05-04 21:51:56,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:51:56,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f671ee8234569b79a20c6a HTTP/1.1" 200 None 2026-05-04 21:51:56,112 - lava_callback - DEBUG - Processing node 69f671ee8234569b79a20c6a: baseline-arm64-baylibre 2026-05-04 21:51:56,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f671ee8234569b79a20c6a 2026-05-04 21:51:56,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:51:56,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f671ee8234569b79a20c6a HTTP/1.1" 200 None 2026-05-04 21:51:56,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:51:56,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:51:56,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:51:56,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f671ee8234569b79a20c6a HTTP/1.1" 200 None 2026-05-04 21:51:56,168 - lava_callback - ERROR - Error processing callback for node 69f671ee8234569b79a20c6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59912 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:53:16,174 - lava_callback - INFO - Received callback for node 69f672398234569b79a20c8b INFO: 172.20.0.1:59920 - "POST /node/69f672398234569b79a20c8b HTTP/1.0" 202 Accepted 2026-05-04 21:53:16,180 - lava_callback - INFO - Starting async job submit for node 69f672398234569b79a20c8b 2026-05-04 21:53:16,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:53:16,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f672398234569b79a20c8b HTTP/1.1" 200 None 2026-05-04 21:53:16,195 - lava_callback - DEBUG - Processing node 69f672398234569b79a20c8b: baseline-arm64-baylibre 2026-05-04 21:53:16,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f672398234569b79a20c8b 2026-05-04 21:53:16,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:53:16,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f672398234569b79a20c8b HTTP/1.1" 200 None 2026-05-04 21:53:16,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:53:16,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:53:16,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:53:16,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f672398234569b79a20c8b HTTP/1.1" 200 None 2026-05-04 21:53:16,242 - lava_callback - ERROR - Error processing callback for node 69f672398234569b79a20c8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32924 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-04 21:54:16,175 - lava_callback - INFO - Received callback for node 69f672838234569b79a20cae INFO: 172.20.0.1:32936 - "POST /node/69f672838234569b79a20cae HTTP/1.0" 202 Accepted 2026-05-04 21:54:16,183 - lava_callback - INFO - Starting async job submit for node 69f672838234569b79a20cae 2026-05-04 21:54:16,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:54:16,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f672838234569b79a20cae HTTP/1.1" 200 None 2026-05-04 21:54:16,201 - lava_callback - DEBUG - Processing node 69f672838234569b79a20cae: baseline-arm64-baylibre 2026-05-04 21:54:16,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f672838234569b79a20cae 2026-05-04 21:54:16,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:54:16,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f672838234569b79a20cae HTTP/1.1" 200 None 2026-05-04 21:54:16,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:54:16,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:54:16,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:54:16,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f672838234569b79a20cae HTTP/1.1" 200 None 2026-05-04 21:54:16,256 - lava_callback - ERROR - Error processing callback for node 69f672838234569b79a20cae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51050 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:55:36,310 - lava_callback - INFO - Received callback for node 69f672cf8234569b79a20cda INFO: 172.20.0.1:57498 - "POST /node/69f672cf8234569b79a20cda HTTP/1.0" 202 Accepted 2026-05-04 21:55:36,316 - lava_callback - INFO - Starting async job submit for node 69f672cf8234569b79a20cda 2026-05-04 21:55:36,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:55:36,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f672cf8234569b79a20cda HTTP/1.1" 200 None 2026-05-04 21:55:36,331 - lava_callback - DEBUG - Processing node 69f672cf8234569b79a20cda: baseline-arm64-baylibre 2026-05-04 21:55:36,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f672cf8234569b79a20cda 2026-05-04 21:55:36,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:55:36,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f672cf8234569b79a20cda HTTP/1.1" 200 None 2026-05-04 21:55:36,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:55:36,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:55:36,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:55:36,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f672cf8234569b79a20cda HTTP/1.1" 200 None 2026-05-04 21:55:36,382 - lava_callback - ERROR - Error processing callback for node 69f672cf8234569b79a20cda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:56:57,025 - lava_callback - INFO - Received callback for node 69f673218234569b79a20d0d INFO: 172.20.0.1:46266 - "POST /node/69f673218234569b79a20d0d HTTP/1.0" 202 Accepted 2026-05-04 21:56:57,032 - lava_callback - INFO - Starting async job submit for node 69f673218234569b79a20d0d 2026-05-04 21:56:57,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:56:57,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f673218234569b79a20d0d HTTP/1.1" 200 None 2026-05-04 21:56:57,047 - lava_callback - DEBUG - Processing node 69f673218234569b79a20d0d: baseline-arm64-clabbe 2026-05-04 21:56:57,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f673218234569b79a20d0d 2026-05-04 21:56:57,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:56:57,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f673218234569b79a20d0d HTTP/1.1" 200 None 2026-05-04 21:56:57,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:56:57,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:56:57,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:56:57,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f673218234569b79a20d0d HTTP/1.1" 200 None 2026-05-04 21:56:57,094 - lava_callback - ERROR - Error processing callback for node 69f673218234569b79a20d0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50588 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:58:16,604 - lava_callback - INFO - Received callback for node 69f673698234569b79a20d2f INFO: 172.20.0.1:50604 - "POST /node/69f673698234569b79a20d2f HTTP/1.0" 202 Accepted 2026-05-04 21:58:16,609 - lava_callback - INFO - Starting async job submit for node 69f673698234569b79a20d2f 2026-05-04 21:58:16,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:58:16,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f673698234569b79a20d2f HTTP/1.1" 200 None 2026-05-04 21:58:16,625 - lava_callback - DEBUG - Processing node 69f673698234569b79a20d2f: baseline-arm64-baylibre 2026-05-04 21:58:16,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f673698234569b79a20d2f 2026-05-04 21:58:16,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:58:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f673698234569b79a20d2f HTTP/1.1" 200 None 2026-05-04 21:58:16,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:58:16,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:58:16,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:58:16,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f673698234569b79a20d2f HTTP/1.1" 200 None 2026-05-04 21:58:16,679 - lava_callback - ERROR - Error processing callback for node 69f673698234569b79a20d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41252 - "GET / HTTP/1.0" 200 OK 2026-05-04 21:59:37,116 - lava_callback - INFO - Received callback for node 69f673ba8234569b79a20d62 INFO: 172.20.0.1:41258 - "POST /node/69f673ba8234569b79a20d62 HTTP/1.0" 202 Accepted 2026-05-04 21:59:37,122 - lava_callback - INFO - Starting async job submit for node 69f673ba8234569b79a20d62 2026-05-04 21:59:37,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:59:37,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f673ba8234569b79a20d62 HTTP/1.1" 200 None 2026-05-04 21:59:37,137 - lava_callback - DEBUG - Processing node 69f673ba8234569b79a20d62: baseline-arm64-clabbe 2026-05-04 21:59:37,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f673ba8234569b79a20d62 2026-05-04 21:59:37,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:59:37,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f673ba8234569b79a20d62 HTTP/1.1" 200 None 2026-05-04 21:59:37,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:59:37,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 21:59:37,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 21:59:37,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f673ba8234569b79a20d62 HTTP/1.1" 200 None 2026-05-04 21:59:37,185 - lava_callback - ERROR - Error processing callback for node 69f673ba8234569b79a20d62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43856 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:00:57,171 - lava_callback - INFO - Received callback for node 69f674088234569b79a20d81 INFO: 172.20.0.1:43860 - "POST /node/69f674088234569b79a20d81 HTTP/1.0" 202 Accepted 2026-05-04 22:00:57,176 - lava_callback - INFO - Starting async job submit for node 69f674088234569b79a20d81 2026-05-04 22:00:57,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:00:57,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674088234569b79a20d81 HTTP/1.1" 200 None 2026-05-04 22:00:57,199 - lava_callback - DEBUG - Processing node 69f674088234569b79a20d81: baseline-arm64-clabbe 2026-05-04 22:00:57,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f674088234569b79a20d81 2026-05-04 22:00:57,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:00:57,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674088234569b79a20d81 HTTP/1.1" 200 None 2026-05-04 22:00:57,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:00:57,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:00:57,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:00:57,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f674088234569b79a20d81 HTTP/1.1" 200 None 2026-05-04 22:00:57,252 - lava_callback - ERROR - Error processing callback for node 69f674088234569b79a20d81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52094 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:02:17,209 - lava_callback - INFO - Received callback for node 69f674578234569b79a20daf INFO: 172.20.0.1:52104 - "POST /node/69f674578234569b79a20daf HTTP/1.0" 202 Accepted 2026-05-04 22:02:17,214 - lava_callback - INFO - Starting async job submit for node 69f674578234569b79a20daf 2026-05-04 22:02:17,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:02:17,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674578234569b79a20daf HTTP/1.1" 200 None 2026-05-04 22:02:17,230 - lava_callback - DEBUG - Processing node 69f674578234569b79a20daf: baseline-arm64-clabbe 2026-05-04 22:02:17,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f674578234569b79a20daf 2026-05-04 22:02:17,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:02:17,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674578234569b79a20daf HTTP/1.1" 200 None 2026-05-04 22:02:17,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:02:17,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:02:17,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:02:17,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f674578234569b79a20daf HTTP/1.1" 200 None 2026-05-04 22:02:17,276 - lava_callback - ERROR - Error processing callback for node 69f674578234569b79a20daf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42618 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:03:16,759 - lava_callback - INFO - Received callback for node 69f674a18234569b79a20ddd INFO: 172.20.0.1:42620 - "POST /node/69f674a18234569b79a20ddd HTTP/1.0" 202 Accepted 2026-05-04 22:03:16,765 - lava_callback - INFO - Starting async job submit for node 69f674a18234569b79a20ddd 2026-05-04 22:03:16,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:03:16,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674a18234569b79a20ddd HTTP/1.1" 200 None 2026-05-04 22:03:16,779 - lava_callback - DEBUG - Processing node 69f674a18234569b79a20ddd: baseline-arm64-baylibre 2026-05-04 22:03:16,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f674a18234569b79a20ddd 2026-05-04 22:03:16,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:03:16,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674a18234569b79a20ddd HTTP/1.1" 200 None 2026-05-04 22:03:16,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:03:16,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:03:16,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:03:16,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f674a18234569b79a20ddd HTTP/1.1" 200 None 2026-05-04 22:03:16,824 - lava_callback - ERROR - Error processing callback for node 69f674a18234569b79a20ddd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54536 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:04:57,315 - lava_callback - INFO - Received callback for node 69f674f68234569b79a20dfc INFO: 172.20.0.1:54542 - "POST /node/69f674f68234569b79a20dfc HTTP/1.0" 202 Accepted 2026-05-04 22:04:57,321 - lava_callback - INFO - Starting async job submit for node 69f674f68234569b79a20dfc 2026-05-04 22:04:57,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:04:57,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674f68234569b79a20dfc HTTP/1.1" 200 None 2026-05-04 22:04:57,337 - lava_callback - DEBUG - Processing node 69f674f68234569b79a20dfc: baseline-arm64-clabbe 2026-05-04 22:04:57,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f674f68234569b79a20dfc 2026-05-04 22:04:57,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:04:57,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f674f68234569b79a20dfc HTTP/1.1" 200 None 2026-05-04 22:04:57,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:04:57,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:04:57,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:04:57,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f674f68234569b79a20dfc HTTP/1.1" 200 None 2026-05-04 22:04:57,383 - lava_callback - ERROR - Error processing callback for node 69f674f68234569b79a20dfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48132 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:06:17,407 - lava_callback - INFO - Received callback for node 69f675478234569b79a20e28 INFO: 172.20.0.1:48142 - "POST /node/69f675478234569b79a20e28 HTTP/1.0" 202 Accepted 2026-05-04 22:06:17,412 - lava_callback - INFO - Starting async job submit for node 69f675478234569b79a20e28 2026-05-04 22:06:17,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:06:17,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f675478234569b79a20e28 HTTP/1.1" 200 None 2026-05-04 22:06:17,428 - lava_callback - DEBUG - Processing node 69f675478234569b79a20e28: baseline-arm64-clabbe 2026-05-04 22:06:17,428 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f675478234569b79a20e28 2026-05-04 22:06:17,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:06:17,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f675478234569b79a20e28 HTTP/1.1" 200 None 2026-05-04 22:06:17,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:06:17,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:06:17,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:06:17,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f675478234569b79a20e28 HTTP/1.1" 200 None 2026-05-04 22:06:17,475 - lava_callback - ERROR - Error processing callback for node 69f675478234569b79a20e28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:07:37,439 - lava_callback - INFO - Received callback for node 69f6759a8234569b79a20e54 INFO: 172.20.0.1:46706 - "POST /node/69f6759a8234569b79a20e54 HTTP/1.0" 202 Accepted 2026-05-04 22:07:37,445 - lava_callback - INFO - Starting async job submit for node 69f6759a8234569b79a20e54 2026-05-04 22:07:37,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:07:37,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6759a8234569b79a20e54 HTTP/1.1" 200 None 2026-05-04 22:07:37,466 - lava_callback - DEBUG - Processing node 69f6759a8234569b79a20e54: baseline-arm64-clabbe 2026-05-04 22:07:37,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6759a8234569b79a20e54 2026-05-04 22:07:37,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:07:37,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6759a8234569b79a20e54 HTTP/1.1" 200 None 2026-05-04 22:07:37,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:07:37,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:07:37,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:07:37,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6759a8234569b79a20e54 HTTP/1.1" 200 None 2026-05-04 22:07:37,524 - lava_callback - ERROR - Error processing callback for node 69f6759a8234569b79a20e54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44182 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:10:17,703 - lava_callback - INFO - Received callback for node 69f6763c8234569b79a20eb4 INFO: 172.20.0.1:44194 - "POST /node/69f6763c8234569b79a20eb4 HTTP/1.0" 202 Accepted 2026-05-04 22:10:17,709 - lava_callback - INFO - Starting async job submit for node 69f6763c8234569b79a20eb4 2026-05-04 22:10:17,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:10:17,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6763c8234569b79a20eb4 HTTP/1.1" 200 None 2026-05-04 22:10:17,725 - lava_callback - DEBUG - Processing node 69f6763c8234569b79a20eb4: baseline-arm64-clabbe 2026-05-04 22:10:17,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6763c8234569b79a20eb4 2026-05-04 22:10:17,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:10:17,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6763c8234569b79a20eb4 HTTP/1.1" 200 None 2026-05-04 22:10:17,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:10:17,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:10:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:10:17,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6763c8234569b79a20eb4 HTTP/1.1" 200 None 2026-05-04 22:10:17,770 - lava_callback - ERROR - Error processing callback for node 69f6763c8234569b79a20eb4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50104 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:11:37,591 - lava_callback - INFO - Received callback for node 69f676898234569b79a20ef4 INFO: 172.20.0.1:50118 - "POST /node/69f676898234569b79a20ef4 HTTP/1.0" 202 Accepted 2026-05-04 22:11:37,597 - lava_callback - INFO - Starting async job submit for node 69f676898234569b79a20ef4 2026-05-04 22:11:37,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:11:37,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f676898234569b79a20ef4 HTTP/1.1" 200 None 2026-05-04 22:11:37,612 - lava_callback - DEBUG - Processing node 69f676898234569b79a20ef4: baseline-arm64-clabbe 2026-05-04 22:11:37,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f676898234569b79a20ef4 2026-05-04 22:11:37,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:11:37,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f676898234569b79a20ef4 HTTP/1.1" 200 None 2026-05-04 22:11:37,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:11:37,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:11:37,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:11:37,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f676898234569b79a20ef4 HTTP/1.1" 200 None 2026-05-04 22:11:37,659 - lava_callback - ERROR - Error processing callback for node 69f676898234569b79a20ef4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49350 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:12:57,600 - lava_callback - INFO - Received callback for node 69f676d98234569b79a20f13 INFO: 172.20.0.1:49366 - "POST /node/69f676d98234569b79a20f13 HTTP/1.0" 202 Accepted 2026-05-04 22:12:57,605 - lava_callback - INFO - Starting async job submit for node 69f676d98234569b79a20f13 2026-05-04 22:12:57,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:12:57,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f676d98234569b79a20f13 HTTP/1.1" 200 None 2026-05-04 22:12:57,621 - lava_callback - DEBUG - Processing node 69f676d98234569b79a20f13: baseline-arm64-clabbe 2026-05-04 22:12:57,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f676d98234569b79a20f13 2026-05-04 22:12:57,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:12:57,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f676d98234569b79a20f13 HTTP/1.1" 200 None 2026-05-04 22:12:57,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:12:57,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:12:57,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:12:57,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f676d98234569b79a20f13 HTTP/1.1" 200 None 2026-05-04 22:12:57,669 - lava_callback - ERROR - Error processing callback for node 69f676d98234569b79a20f13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:14:17,741 - lava_callback - INFO - Received callback for node 69f6772a8234569b79a20f3d INFO: 172.20.0.1:43628 - "POST /node/69f6772a8234569b79a20f3d HTTP/1.0" 202 Accepted 2026-05-04 22:14:17,746 - lava_callback - INFO - Starting async job submit for node 69f6772a8234569b79a20f3d 2026-05-04 22:14:17,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:14:17,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6772a8234569b79a20f3d HTTP/1.1" 200 None 2026-05-04 22:14:17,767 - lava_callback - DEBUG - Processing node 69f6772a8234569b79a20f3d: baseline-arm64-clabbe 2026-05-04 22:14:17,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6772a8234569b79a20f3d 2026-05-04 22:14:17,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:14:17,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6772a8234569b79a20f3d HTTP/1.1" 200 None 2026-05-04 22:14:17,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:14:17,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:14:17,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:14:17,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6772a8234569b79a20f3d HTTP/1.1" 200 None 2026-05-04 22:14:17,821 - lava_callback - ERROR - Error processing callback for node 69f6772a8234569b79a20f3d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42292 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:15:37,748 - lava_callback - INFO - Received callback for node 69f6777e8234569b79a20f64 INFO: 172.20.0.1:42308 - "POST /node/69f6777e8234569b79a20f64 HTTP/1.0" 202 Accepted 2026-05-04 22:15:37,754 - lava_callback - INFO - Starting async job submit for node 69f6777e8234569b79a20f64 2026-05-04 22:15:37,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:15:37,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6777e8234569b79a20f64 HTTP/1.1" 200 None 2026-05-04 22:15:37,770 - lava_callback - DEBUG - Processing node 69f6777e8234569b79a20f64: baseline-arm64-clabbe 2026-05-04 22:15:37,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6777e8234569b79a20f64 2026-05-04 22:15:37,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:15:37,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6777e8234569b79a20f64 HTTP/1.1" 200 None 2026-05-04 22:15:37,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:15:37,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:15:37,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:15:37,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6777e8234569b79a20f64 HTTP/1.1" 200 None 2026-05-04 22:15:37,823 - lava_callback - ERROR - Error processing callback for node 69f6777e8234569b79a20f64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55018 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:18:17,800 - lava_callback - INFO - Received callback for node 69f6781f8234569b79a20faa INFO: 172.20.0.1:55026 - "POST /node/69f6781f8234569b79a20faa HTTP/1.0" 202 Accepted 2026-05-04 22:18:17,805 - lava_callback - INFO - Starting async job submit for node 69f6781f8234569b79a20faa 2026-05-04 22:18:17,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:18:17,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6781f8234569b79a20faa HTTP/1.1" 200 None 2026-05-04 22:18:17,821 - lava_callback - DEBUG - Processing node 69f6781f8234569b79a20faa: baseline-arm64-clabbe 2026-05-04 22:18:17,821 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6781f8234569b79a20faa 2026-05-04 22:18:17,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:18:17,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6781f8234569b79a20faa HTTP/1.1" 200 None 2026-05-04 22:18:17,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:18:17,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:18:17,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:18:17,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6781f8234569b79a20faa HTTP/1.1" 200 None 2026-05-04 22:18:17,866 - lava_callback - ERROR - Error processing callback for node 69f6781f8234569b79a20faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57174 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:19:37,888 - lava_callback - INFO - Received callback for node 69f6786b8234569b79a20ff3 INFO: 172.20.0.1:57180 - "POST /node/69f6786b8234569b79a20ff3 HTTP/1.0" 202 Accepted 2026-05-04 22:19:37,894 - lava_callback - INFO - Starting async job submit for node 69f6786b8234569b79a20ff3 2026-05-04 22:19:37,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:19:37,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6786b8234569b79a20ff3 HTTP/1.1" 200 None 2026-05-04 22:19:37,909 - lava_callback - DEBUG - Processing node 69f6786b8234569b79a20ff3: baseline-arm64-clabbe 2026-05-04 22:19:37,909 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6786b8234569b79a20ff3 2026-05-04 22:19:37,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:19:37,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6786b8234569b79a20ff3 HTTP/1.1" 200 None 2026-05-04 22:19:37,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:19:37,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:19:37,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:19:37,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6786b8234569b79a20ff3 HTTP/1.1" 200 None 2026-05-04 22:19:37,954 - lava_callback - ERROR - Error processing callback for node 69f6786b8234569b79a20ff3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:22:17,924 - lava_callback - INFO - Received callback for node 69f679088234569b79a21050 INFO: 172.20.0.1:49312 - "POST /node/69f679088234569b79a21050 HTTP/1.0" 202 Accepted 2026-05-04 22:22:17,929 - lava_callback - INFO - Starting async job submit for node 69f679088234569b79a21050 2026-05-04 22:22:17,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:22:17,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f679088234569b79a21050 HTTP/1.1" 200 None 2026-05-04 22:22:17,945 - lava_callback - DEBUG - Processing node 69f679088234569b79a21050: baseline-arm64-clabbe 2026-05-04 22:22:17,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f679088234569b79a21050 2026-05-04 22:22:17,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:22:17,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f679088234569b79a21050 HTTP/1.1" 200 None 2026-05-04 22:22:17,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:22:17,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:22:17,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:22:17,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f679088234569b79a21050 HTTP/1.1" 200 None 2026-05-04 22:22:17,990 - lava_callback - ERROR - Error processing callback for node 69f679088234569b79a21050: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:23:38,031 - lava_callback - INFO - Received callback for node 69f679568234569b79a2107c INFO: 172.20.0.1:60838 - "POST /node/69f679568234569b79a2107c HTTP/1.0" 202 Accepted 2026-05-04 22:23:38,037 - lava_callback - INFO - Starting async job submit for node 69f679568234569b79a2107c 2026-05-04 22:23:38,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:23:38,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f679568234569b79a2107c HTTP/1.1" 200 None 2026-05-04 22:23:38,052 - lava_callback - DEBUG - Processing node 69f679568234569b79a2107c: baseline-arm64-clabbe 2026-05-04 22:23:38,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f679568234569b79a2107c 2026-05-04 22:23:38,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:23:38,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f679568234569b79a2107c HTTP/1.1" 200 None 2026-05-04 22:23:38,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:23:38,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f310b793551c40ae2f3c0b HTTP/1.1" 200 None 2026-05-04 22:23:38,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:23:38,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f679568234569b79a2107c HTTP/1.1" 200 None 2026-05-04 22:23:38,100 - lava_callback - ERROR - Error processing callback for node 69f679568234569b79a2107c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37740 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:43:59,011 - lava_callback - INFO - Received callback for node 69f67e208234569b79a210fc INFO: 172.20.0.1:37752 - "POST /node/69f67e208234569b79a210fc HTTP/1.0" 202 Accepted 2026-05-04 22:43:59,016 - lava_callback - INFO - Starting async job submit for node 69f67e208234569b79a210fc 2026-05-04 22:43:59,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:43:59,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67e208234569b79a210fc HTTP/1.1" 200 None 2026-05-04 22:43:59,032 - lava_callback - DEBUG - Processing node 69f67e208234569b79a210fc: baseline-arm-baylibre 2026-05-04 22:43:59,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f67e208234569b79a210fc 2026-05-04 22:43:59,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:43:59,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67e208234569b79a210fc HTTP/1.1" 200 None 2026-05-04 22:43:59,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:43:59,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 22:43:59,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:43:59,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f67e208234569b79a210fc HTTP/1.1" 200 None 2026-05-04 22:43:59,102 - lava_callback - ERROR - Error processing callback for node 69f67e208234569b79a210fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42332 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:44:38,931 - lava_callback - INFO - Received callback for node 69f67e448234569b79a21109 INFO: 172.20.0.1:42342 - "POST /node/69f67e448234569b79a21109 HTTP/1.0" 202 Accepted 2026-05-04 22:44:38,936 - lava_callback - INFO - Starting async job submit for node 69f67e448234569b79a21109 2026-05-04 22:44:38,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:44:38,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67e448234569b79a21109 HTTP/1.1" 200 None 2026-05-04 22:44:38,950 - lava_callback - DEBUG - Processing node 69f67e448234569b79a21109: baseline-arm-baylibre 2026-05-04 22:44:38,950 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f67e448234569b79a21109 2026-05-04 22:44:38,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:44:38,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67e448234569b79a21109 HTTP/1.1" 200 None 2026-05-04 22:44:38,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:44:38,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 22:44:38,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:44:38,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f67e448234569b79a21109 HTTP/1.1" 200 None 2026-05-04 22:44:38,997 - lava_callback - ERROR - Error processing callback for node 69f67e448234569b79a21109: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44900 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:48:39,092 - lava_callback - INFO - Received callback for node 69f67f3b8234569b79a2116d INFO: 172.20.0.1:44916 - "POST /node/69f67f3b8234569b79a2116d HTTP/1.0" 202 Accepted 2026-05-04 22:48:39,098 - lava_callback - INFO - Starting async job submit for node 69f67f3b8234569b79a2116d 2026-05-04 22:48:39,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:48:39,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67f3b8234569b79a2116d HTTP/1.1" 200 None 2026-05-04 22:48:39,116 - lava_callback - DEBUG - Processing node 69f67f3b8234569b79a2116d: baseline-arm-clabbe 2026-05-04 22:48:39,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f67f3b8234569b79a2116d 2026-05-04 22:48:39,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:48:39,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67f3b8234569b79a2116d HTTP/1.1" 200 None 2026-05-04 22:48:39,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:48:39,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 22:48:39,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:48:39,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f67f3b8234569b79a2116d HTTP/1.1" 200 None 2026-05-04 22:48:39,170 - lava_callback - ERROR - Error processing callback for node 69f67f3b8234569b79a2116d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38536 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:50:39,085 - lava_callback - INFO - Received callback for node 69f67fa88234569b79a211ce INFO: 172.20.0.1:38550 - "POST /node/69f67fa88234569b79a211ce HTTP/1.0" 202 Accepted 2026-05-04 22:50:39,091 - lava_callback - INFO - Starting async job submit for node 69f67fa88234569b79a211ce 2026-05-04 22:50:39,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:39,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67fa88234569b79a211ce HTTP/1.1" 200 None 2026-05-04 22:50:39,107 - lava_callback - DEBUG - Processing node 69f67fa88234569b79a211ce: baseline-arm-clabbe 2026-05-04 22:50:39,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f67fa88234569b79a211ce 2026-05-04 22:50:39,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:39,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67fa88234569b79a211ce HTTP/1.1" 200 None 2026-05-04 22:50:39,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:39,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 22:50:39,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:39,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f67fa88234569b79a211ce HTTP/1.1" 200 None 2026-05-04 22:50:39,152 - lava_callback - ERROR - Error processing callback for node 69f67fa88234569b79a211ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40720 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:50:59,015 - lava_callback - INFO - Received callback for node 69f67fcd8234569b79a211da INFO: 172.20.0.1:40736 - "POST /node/69f67fcd8234569b79a211da HTTP/1.0" 202 Accepted 2026-05-04 22:50:59,021 - lava_callback - INFO - Starting async job submit for node 69f67fcd8234569b79a211da 2026-05-04 22:50:59,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:59,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67fcd8234569b79a211da HTTP/1.1" 200 None 2026-05-04 22:50:59,040 - lava_callback - DEBUG - Processing node 69f67fcd8234569b79a211da: baseline-arm-clabbe 2026-05-04 22:50:59,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f67fcd8234569b79a211da 2026-05-04 22:50:59,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:59,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67fcd8234569b79a211da HTTP/1.1" 200 None 2026-05-04 22:50:59,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:59,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 22:50:59,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:50:59,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f67fcd8234569b79a211da HTTP/1.1" 200 None 2026-05-04 22:50:59,130 - lava_callback - ERROR - Error processing callback for node 69f67fcd8234569b79a211da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47672 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:51:39,104 - lava_callback - INFO - Received callback for node 69f67ff28234569b79a211e9 INFO: 172.20.0.1:47686 - "POST /node/69f67ff28234569b79a211e9 HTTP/1.0" 202 Accepted 2026-05-04 22:51:39,109 - lava_callback - INFO - Starting async job submit for node 69f67ff28234569b79a211e9 2026-05-04 22:51:39,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:51:39,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67ff28234569b79a211e9 HTTP/1.1" 200 None 2026-05-04 22:51:39,125 - lava_callback - DEBUG - Processing node 69f67ff28234569b79a211e9: baseline-arm-clabbe 2026-05-04 22:51:39,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f67ff28234569b79a211e9 2026-05-04 22:51:39,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:51:39,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f67ff28234569b79a211e9 HTTP/1.1" 200 None 2026-05-04 22:51:39,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:51:39,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 22:51:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:51:39,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f67ff28234569b79a211e9 HTTP/1.1" 200 None 2026-05-04 22:51:39,184 - lava_callback - ERROR - Error processing callback for node 69f67ff28234569b79a211e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56394 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:53:39,182 - lava_callback - INFO - Received callback for node 69f6805f8234569b79a21214 INFO: 172.20.0.1:56400 - "POST /node/69f6805f8234569b79a21214 HTTP/1.0" 202 Accepted 2026-05-04 22:53:39,188 - lava_callback - INFO - Starting async job submit for node 69f6805f8234569b79a21214 2026-05-04 22:53:39,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:39,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6805f8234569b79a21214 HTTP/1.1" 200 None 2026-05-04 22:53:39,203 - lava_callback - DEBUG - Processing node 69f6805f8234569b79a21214: baseline-arm-clabbe 2026-05-04 22:53:39,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6805f8234569b79a21214 2026-05-04 22:53:39,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:39,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6805f8234569b79a21214 HTTP/1.1" 200 None 2026-05-04 22:53:39,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:39,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623a28234569b79a1c04a HTTP/1.1" 200 None 2026-05-04 22:53:39,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:39,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6805f8234569b79a21214 HTTP/1.1" 200 None 2026-05-04 22:53:39,249 - lava_callback - ERROR - Error processing callback for node 69f6805f8234569b79a21214: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:53:59,541 - lava_callback - INFO - Received callback for node 69f6807f8234569b79a2121f INFO: 172.20.0.1:37342 - "POST /node/69f6807f8234569b79a2121f HTTP/1.0" 202 Accepted 2026-05-04 22:53:59,547 - lava_callback - INFO - Starting async job submit for node 69f6807f8234569b79a2121f 2026-05-04 22:53:59,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:59,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6807f8234569b79a2121f HTTP/1.1" 200 None 2026-05-04 22:53:59,563 - lava_callback - DEBUG - Processing node 69f6807f8234569b79a2121f: baseline-arm-baylibre 2026-05-04 22:53:59,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6807f8234569b79a2121f 2026-05-04 22:53:59,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:59,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6807f8234569b79a2121f HTTP/1.1" 200 None 2026-05-04 22:53:59,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:59,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 22:53:59,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:53:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6807f8234569b79a2121f HTTP/1.1" 200 None 2026-05-04 22:53:59,609 - lava_callback - ERROR - Error processing callback for node 69f6807f8234569b79a2121f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59180 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:54:39,488 - lava_callback - INFO - Received callback for node 69f680a38234569b79a2122d INFO: 172.20.0.1:59194 - "POST /node/69f680a38234569b79a2122d HTTP/1.0" 202 Accepted 2026-05-04 22:54:39,493 - lava_callback - INFO - Starting async job submit for node 69f680a38234569b79a2122d 2026-05-04 22:54:39,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:54:39,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f680a38234569b79a2122d HTTP/1.1" 200 None 2026-05-04 22:54:39,523 - lava_callback - DEBUG - Processing node 69f680a38234569b79a2122d: baseline-arm-baylibre 2026-05-04 22:54:39,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f680a38234569b79a2122d 2026-05-04 22:54:39,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:54:39,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f680a38234569b79a2122d HTTP/1.1" 200 None 2026-05-04 22:54:39,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:54:39,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 22:54:39,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:54:39,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f680a38234569b79a2122d HTTP/1.1" 200 None 2026-05-04 22:54:39,571 - lava_callback - ERROR - Error processing callback for node 69f680a38234569b79a2122d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53368 - "GET / HTTP/1.0" 200 OK 2026-05-04 22:55:19,583 - lava_callback - INFO - Received callback for node 69f680c88234569b79a2123a INFO: 172.20.0.1:53380 - "POST /node/69f680c88234569b79a2123a HTTP/1.0" 202 Accepted 2026-05-04 22:55:19,589 - lava_callback - INFO - Starting async job submit for node 69f680c88234569b79a2123a 2026-05-04 22:55:19,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:55:19,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f680c88234569b79a2123a HTTP/1.1" 200 None 2026-05-04 22:55:19,604 - lava_callback - DEBUG - Processing node 69f680c88234569b79a2123a: baseline-arm-baylibre 2026-05-04 22:55:19,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f680c88234569b79a2123a 2026-05-04 22:55:19,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:55:19,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f680c88234569b79a2123a HTTP/1.1" 200 None 2026-05-04 22:55:19,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:55:19,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 22:55:19,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 22:55:19,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f680c88234569b79a2123a HTTP/1.1" 200 None 2026-05-04 22:55:19,651 - lava_callback - ERROR - Error processing callback for node 69f680c88234569b79a2123a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45678 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:00:59,887 - lava_callback - INFO - Received callback for node 69f682218234569b79a212fb INFO: 172.20.0.1:42764 - "POST /node/69f682218234569b79a212fb HTTP/1.0" 202 Accepted 2026-05-04 23:00:59,893 - lava_callback - INFO - Starting async job submit for node 69f682218234569b79a212fb 2026-05-04 23:00:59,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:00:59,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f682218234569b79a212fb HTTP/1.1" 200 None 2026-05-04 23:00:59,908 - lava_callback - DEBUG - Processing node 69f682218234569b79a212fb: baseline-arm64-baylibre 2026-05-04 23:00:59,908 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f682218234569b79a212fb 2026-05-04 23:00:59,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:00:59,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f682218234569b79a212fb HTTP/1.1" 200 None 2026-05-04 23:00:59,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:00:59,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:00:59,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:00:59,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f682218234569b79a212fb HTTP/1.1" 200 None 2026-05-04 23:00:59,958 - lava_callback - ERROR - Error processing callback for node 69f682218234569b79a212fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57956 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:02:19,942 - lava_callback - INFO - Received callback for node 69f6826b8234569b79a21320 INFO: 172.20.0.1:35918 - "POST /node/69f6826b8234569b79a21320 HTTP/1.0" 202 Accepted 2026-05-04 23:02:19,948 - lava_callback - INFO - Starting async job submit for node 69f6826b8234569b79a21320 2026-05-04 23:02:19,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:02:19,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6826b8234569b79a21320 HTTP/1.1" 200 None 2026-05-04 23:02:19,970 - lava_callback - DEBUG - Processing node 69f6826b8234569b79a21320: baseline-arm64-baylibre 2026-05-04 23:02:19,970 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6826b8234569b79a21320 2026-05-04 23:02:19,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:02:19,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6826b8234569b79a21320 HTTP/1.1" 200 None 2026-05-04 23:02:19,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:02:19,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:02:20,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:02:20,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6826b8234569b79a21320 HTTP/1.1" 200 None 2026-05-04 23:02:20,021 - lava_callback - ERROR - Error processing callback for node 69f6826b8234569b79a21320: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55330 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:03:40,004 - lava_callback - INFO - Received callback for node 69f682b68234569b79a21352 INFO: 172.20.0.1:43462 - "POST /node/69f682b68234569b79a21352 HTTP/1.0" 202 Accepted 2026-05-04 23:03:40,009 - lava_callback - INFO - Starting async job submit for node 69f682b68234569b79a21352 2026-05-04 23:03:40,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:03:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f682b68234569b79a21352 HTTP/1.1" 200 None 2026-05-04 23:03:40,024 - lava_callback - DEBUG - Processing node 69f682b68234569b79a21352: baseline-arm64-baylibre 2026-05-04 23:03:40,024 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f682b68234569b79a21352 2026-05-04 23:03:40,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:03:40,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f682b68234569b79a21352 HTTP/1.1" 200 None 2026-05-04 23:03:40,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:03:40,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:03:40,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:03:40,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f682b68234569b79a21352 HTTP/1.1" 200 None 2026-05-04 23:03:40,119 - lava_callback - ERROR - Error processing callback for node 69f682b68234569b79a21352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57110 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:04:39,976 - lava_callback - INFO - Received callback for node 69f683038234569b79a21377 INFO: 172.20.0.1:57514 - "POST /node/69f683038234569b79a21377 HTTP/1.0" 202 Accepted 2026-05-04 23:04:39,982 - lava_callback - INFO - Starting async job submit for node 69f683038234569b79a21377 2026-05-04 23:04:39,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:04:40,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f683038234569b79a21377 HTTP/1.1" 200 None 2026-05-04 23:04:40,007 - lava_callback - DEBUG - Processing node 69f683038234569b79a21377: baseline-arm64-baylibre 2026-05-04 23:04:40,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f683038234569b79a21377 2026-05-04 23:04:40,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:04:40,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f683038234569b79a21377 HTTP/1.1" 200 None 2026-05-04 23:04:40,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:04:40,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:04:40,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:04:40,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f683038234569b79a21377 HTTP/1.1" 200 None 2026-05-04 23:04:40,055 - lava_callback - ERROR - Error processing callback for node 69f683038234569b79a21377: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49400 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:07:20,186 - lava_callback - INFO - Received callback for node 69f683978234569b79a213ca INFO: 172.20.0.1:34184 - "POST /node/69f683978234569b79a213ca HTTP/1.0" 202 Accepted 2026-05-04 23:07:20,194 - lava_callback - INFO - Starting async job submit for node 69f683978234569b79a213ca 2026-05-04 23:07:20,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:07:20,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f683978234569b79a213ca HTTP/1.1" 200 None 2026-05-04 23:07:20,210 - lava_callback - DEBUG - Processing node 69f683978234569b79a213ca: baseline-arm64-baylibre 2026-05-04 23:07:20,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f683978234569b79a213ca 2026-05-04 23:07:20,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:07:20,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f683978234569b79a213ca HTTP/1.1" 200 None 2026-05-04 23:07:20,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:07:20,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:07:20,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:07:20,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f683978234569b79a213ca HTTP/1.1" 200 None 2026-05-04 23:07:20,270 - lava_callback - ERROR - Error processing callback for node 69f683978234569b79a213ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58566 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:08:20,210 - lava_callback - INFO - Received callback for node 69f683d78234569b79a213f0 INFO: 172.20.0.1:32782 - "POST /node/69f683d78234569b79a213f0 HTTP/1.0" 202 Accepted 2026-05-04 23:08:20,216 - lava_callback - INFO - Starting async job submit for node 69f683d78234569b79a213f0 2026-05-04 23:08:20,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:08:20,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f683d78234569b79a213f0 HTTP/1.1" 200 None 2026-05-04 23:08:20,232 - lava_callback - DEBUG - Processing node 69f683d78234569b79a213f0: baseline-arm-baylibre 2026-05-04 23:08:20,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f683d78234569b79a213f0 2026-05-04 23:08:20,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:08:20,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f683d78234569b79a213f0 HTTP/1.1" 200 None 2026-05-04 23:08:20,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:08:20,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:08:20,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:08:20,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f683d78234569b79a213f0 HTTP/1.1" 200 None 2026-05-04 23:08:20,283 - lava_callback - ERROR - Error processing callback for node 69f683d78234569b79a213f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51556 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:09:19,857 - lava_callback - INFO - Received callback for node 69f6840c8234569b79a21408 INFO: 172.20.0.1:54014 - "POST /node/69f6840c8234569b79a21408 HTTP/1.0" 202 Accepted 2026-05-04 23:09:19,867 - lava_callback - INFO - Starting async job submit for node 69f6840c8234569b79a21408 2026-05-04 23:09:19,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:09:19,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6840c8234569b79a21408 HTTP/1.1" 200 None 2026-05-04 23:09:19,883 - lava_callback - DEBUG - Processing node 69f6840c8234569b79a21408: baseline-arm64-clabbe 2026-05-04 23:09:19,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6840c8234569b79a21408 2026-05-04 23:09:19,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:09:19,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6840c8234569b79a21408 HTTP/1.1" 200 None 2026-05-04 23:09:19,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:09:19,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:09:19,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:09:19,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6840c8234569b79a21408 HTTP/1.1" 200 None 2026-05-04 23:09:19,929 - lava_callback - ERROR - Error processing callback for node 69f6840c8234569b79a21408: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43910 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:10:20,054 - lava_callback - INFO - Received callback for node 69f684588234569b79a21442 INFO: 172.20.0.1:34398 - "POST /node/69f684588234569b79a21442 HTTP/1.0" 202 Accepted 2026-05-04 23:10:20,060 - lava_callback - INFO - Starting async job submit for node 69f684588234569b79a21442 2026-05-04 23:10:20,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:10:20,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f684588234569b79a21442 HTTP/1.1" 200 None 2026-05-04 23:10:20,076 - lava_callback - DEBUG - Processing node 69f684588234569b79a21442: baseline-arm64-clabbe 2026-05-04 23:10:20,076 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f684588234569b79a21442 2026-05-04 23:10:20,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:10:20,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f684588234569b79a21442 HTTP/1.1" 200 None 2026-05-04 23:10:20,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:10:20,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:10:20,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:10:20,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f684588234569b79a21442 HTTP/1.1" 200 None 2026-05-04 23:10:20,123 - lava_callback - ERROR - Error processing callback for node 69f684588234569b79a21442: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58924 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:11:40,215 - lava_callback - INFO - Received callback for node 69f684a58234569b79a21460 INFO: 172.20.0.1:58592 - "POST /node/69f684a58234569b79a21460 HTTP/1.0" 202 Accepted 2026-05-04 23:11:40,220 - lava_callback - INFO - Starting async job submit for node 69f684a58234569b79a21460 2026-05-04 23:11:40,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:11:40,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f684a58234569b79a21460 HTTP/1.1" 200 None 2026-05-04 23:11:40,236 - lava_callback - DEBUG - Processing node 69f684a58234569b79a21460: baseline-arm64-clabbe 2026-05-04 23:11:40,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f684a58234569b79a21460 2026-05-04 23:11:40,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:11:40,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f684a58234569b79a21460 HTTP/1.1" 200 None 2026-05-04 23:11:40,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:11:40,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:11:40,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:11:40,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f684a58234569b79a21460 HTTP/1.1" 200 None 2026-05-04 23:11:40,292 - lava_callback - ERROR - Error processing callback for node 69f684a58234569b79a21460: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53112 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:12:59,980 - lava_callback - INFO - Received callback for node 69f684f18234569b79a2149a INFO: 172.20.0.1:49024 - "POST /node/69f684f18234569b79a2149a HTTP/1.0" 202 Accepted 2026-05-04 23:12:59,990 - lava_callback - INFO - Starting async job submit for node 69f684f18234569b79a2149a 2026-05-04 23:12:59,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:13:00,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f684f18234569b79a2149a HTTP/1.1" 200 None 2026-05-04 23:13:00,010 - lava_callback - DEBUG - Processing node 69f684f18234569b79a2149a: baseline-arm64-clabbe 2026-05-04 23:13:00,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f684f18234569b79a2149a 2026-05-04 23:13:00,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:13:00,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f684f18234569b79a2149a HTTP/1.1" 200 None 2026-05-04 23:13:00,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:13:00,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:13:00,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:13:00,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f684f18234569b79a2149a HTTP/1.1" 200 None 2026-05-04 23:13:00,068 - lava_callback - ERROR - Error processing callback for node 69f684f18234569b79a2149a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40612 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:15:40,073 - lava_callback - INFO - Received callback for node 69f685878234569b79a214ee INFO: 172.20.0.1:48284 - "POST /node/69f685878234569b79a214ee HTTP/1.0" 202 Accepted 2026-05-04 23:15:40,078 - lava_callback - INFO - Starting async job submit for node 69f685878234569b79a214ee 2026-05-04 23:15:40,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:15:40,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f685878234569b79a214ee HTTP/1.1" 200 None 2026-05-04 23:15:40,093 - lava_callback - DEBUG - Processing node 69f685878234569b79a214ee: baseline-arm64-clabbe 2026-05-04 23:15:40,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f685878234569b79a214ee 2026-05-04 23:15:40,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:15:40,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f685878234569b79a214ee HTTP/1.1" 200 None 2026-05-04 23:15:40,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:15:40,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:15:40,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:15:40,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f685878234569b79a214ee HTTP/1.1" 200 None 2026-05-04 23:15:40,145 - lava_callback - ERROR - Error processing callback for node 69f685878234569b79a214ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52002 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:16:40,105 - lava_callback - INFO - Received callback for node 69f685d38234569b79a2150a INFO: 172.20.0.1:46640 - "POST /node/69f685d38234569b79a2150a HTTP/1.0" 202 Accepted 2026-05-04 23:16:40,111 - lava_callback - INFO - Starting async job submit for node 69f685d38234569b79a2150a 2026-05-04 23:16:40,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:16:40,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f685d38234569b79a2150a HTTP/1.1" 200 None 2026-05-04 23:16:40,138 - lava_callback - DEBUG - Processing node 69f685d38234569b79a2150a: baseline-arm64-clabbe 2026-05-04 23:16:40,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f685d38234569b79a2150a 2026-05-04 23:16:40,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:16:40,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f685d38234569b79a2150a HTTP/1.1" 200 None 2026-05-04 23:16:40,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:16:40,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f623ae8234569b79a1c059 HTTP/1.1" 200 None 2026-05-04 23:16:40,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:16:40,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f685d38234569b79a2150a HTTP/1.1" 200 None 2026-05-04 23:16:40,186 - lava_callback - ERROR - Error processing callback for node 69f685d38234569b79a2150a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39510 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:17:41,024 - lava_callback - INFO - Received callback for node 69f6860d8234569b79a2152c INFO: 172.20.0.1:39684 - "POST /node/69f6860d8234569b79a2152c HTTP/1.0" 202 Accepted 2026-05-04 23:17:41,033 - lava_callback - INFO - Starting async job submit for node 69f6860d8234569b79a2152c 2026-05-04 23:17:41,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:17:41,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6860d8234569b79a2152c HTTP/1.1" 200 None 2026-05-04 23:17:41,049 - lava_callback - DEBUG - Processing node 69f6860d8234569b79a2152c: baseline-arm-baylibre 2026-05-04 23:17:41,049 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6860d8234569b79a2152c 2026-05-04 23:17:41,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:17:41,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6860d8234569b79a2152c HTTP/1.1" 200 None 2026-05-04 23:17:41,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:17:41,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:17:41,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:17:41,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6860d8234569b79a2152c HTTP/1.1" 200 None 2026-05-04 23:17:41,099 - lava_callback - ERROR - Error processing callback for node 69f6860d8234569b79a2152c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56782 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:18:20,717 - lava_callback - INFO - Received callback for node 69f686318234569b79a21543 INFO: 172.20.0.1:35512 - "POST /node/69f686318234569b79a21543 HTTP/1.0" 202 Accepted 2026-05-04 23:18:20,722 - lava_callback - INFO - Starting async job submit for node 69f686318234569b79a21543 2026-05-04 23:18:20,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:18:20,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f686318234569b79a21543 HTTP/1.1" 200 None 2026-05-04 23:18:20,739 - lava_callback - DEBUG - Processing node 69f686318234569b79a21543: baseline-arm-baylibre 2026-05-04 23:18:20,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f686318234569b79a21543 2026-05-04 23:18:20,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:18:20,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f686318234569b79a21543 HTTP/1.1" 200 None 2026-05-04 23:18:20,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:18:20,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:18:20,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:18:20,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f686318234569b79a21543 HTTP/1.1" 200 None 2026-05-04 23:18:20,790 - lava_callback - ERROR - Error processing callback for node 69f686318234569b79a21543: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54136 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:19:00,994 - lava_callback - INFO - Received callback for node 69f686518234569b79a21551 INFO: 172.20.0.1:41546 - "POST /node/69f686518234569b79a21551 HTTP/1.0" 202 Accepted 2026-05-04 23:19:00,999 - lava_callback - INFO - Starting async job submit for node 69f686518234569b79a21551 2026-05-04 23:19:01,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:01,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f686518234569b79a21551 HTTP/1.1" 200 None 2026-05-04 23:19:01,014 - lava_callback - DEBUG - Processing node 69f686518234569b79a21551: baseline-arm-baylibre 2026-05-04 23:19:01,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f686518234569b79a21551 2026-05-04 23:19:01,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:01,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f686518234569b79a21551 HTTP/1.1" 200 None 2026-05-04 23:19:01,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:01,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:19:01,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:01,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f686518234569b79a21551 HTTP/1.1" 200 None 2026-05-04 23:19:01,059 - lava_callback - ERROR - Error processing callback for node 69f686518234569b79a21551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50424 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:19:40,375 - lava_callback - INFO - Received callback for node 69f6867a8234569b79a21563 INFO: 172.20.0.1:52334 - "POST /node/69f6867a8234569b79a21563 HTTP/1.0" 202 Accepted 2026-05-04 23:19:40,384 - lava_callback - INFO - Starting async job submit for node 69f6867a8234569b79a21563 2026-05-04 23:19:40,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:40,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6867a8234569b79a21563 HTTP/1.1" 200 None 2026-05-04 23:19:40,408 - lava_callback - DEBUG - Processing node 69f6867a8234569b79a21563: baseline-arm-clabbe 2026-05-04 23:19:40,408 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6867a8234569b79a21563 2026-05-04 23:19:40,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:40,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6867a8234569b79a21563 HTTP/1.1" 200 None 2026-05-04 23:19:40,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:40,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:19:40,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:19:40,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6867a8234569b79a21563 HTTP/1.1" 200 None 2026-05-04 23:19:40,470 - lava_callback - ERROR - Error processing callback for node 69f6867a8234569b79a21563: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46156 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:22:40,343 - lava_callback - INFO - Received callback for node 69f6872d8234569b79a215b0 INFO: 172.20.0.1:55448 - "POST /node/69f6872d8234569b79a215b0 HTTP/1.0" 202 Accepted 2026-05-04 23:22:40,348 - lava_callback - INFO - Starting async job submit for node 69f6872d8234569b79a215b0 2026-05-04 23:22:40,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:22:40,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6872d8234569b79a215b0 HTTP/1.1" 200 None 2026-05-04 23:22:40,364 - lava_callback - DEBUG - Processing node 69f6872d8234569b79a215b0: baseline-arm-clabbe 2026-05-04 23:22:40,364 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6872d8234569b79a215b0 2026-05-04 23:22:40,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:22:40,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6872d8234569b79a215b0 HTTP/1.1" 200 None 2026-05-04 23:22:40,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:22:40,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:22:40,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:22:40,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6872d8234569b79a215b0 HTTP/1.1" 200 None 2026-05-04 23:22:40,434 - lava_callback - ERROR - Error processing callback for node 69f6872d8234569b79a215b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:23:40,744 - lava_callback - INFO - Received callback for node 69f687738234569b79a215cc INFO: 172.20.0.1:43068 - "POST /node/69f687738234569b79a215cc HTTP/1.0" 202 Accepted 2026-05-04 23:23:40,749 - lava_callback - INFO - Starting async job submit for node 69f687738234569b79a215cc 2026-05-04 23:23:40,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:23:40,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f687738234569b79a215cc HTTP/1.1" 200 None 2026-05-04 23:23:40,764 - lava_callback - DEBUG - Processing node 69f687738234569b79a215cc: baseline-arm-clabbe 2026-05-04 23:23:40,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f687738234569b79a215cc 2026-05-04 23:23:40,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:23:40,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f687738234569b79a215cc HTTP/1.1" 200 None 2026-05-04 23:23:40,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:23:40,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:23:40,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:23:40,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f687738234569b79a215cc HTTP/1.1" 200 None 2026-05-04 23:23:40,815 - lava_callback - ERROR - Error processing callback for node 69f687738234569b79a215cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41790 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:25:00,385 - lava_callback - INFO - Received callback for node 69f687bb8234569b79a215ea INFO: 172.20.0.1:47184 - "POST /node/69f687bb8234569b79a215ea HTTP/1.0" 202 Accepted 2026-05-04 23:25:00,390 - lava_callback - INFO - Starting async job submit for node 69f687bb8234569b79a215ea 2026-05-04 23:25:00,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:00,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f687bb8234569b79a215ea HTTP/1.1" 200 None 2026-05-04 23:25:00,413 - lava_callback - DEBUG - Processing node 69f687bb8234569b79a215ea: baseline-arm-clabbe 2026-05-04 23:25:00,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f687bb8234569b79a215ea 2026-05-04 23:25:00,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:00,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f687bb8234569b79a215ea HTTP/1.1" 200 None 2026-05-04 23:25:00,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:00,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:25:00,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:00,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f687bb8234569b79a215ea HTTP/1.1" 200 None 2026-05-04 23:25:00,459 - lava_callback - ERROR - Error processing callback for node 69f687bb8234569b79a215ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48776 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:25:40,359 - lava_callback - INFO - Received callback for node 69f687df8234569b79a215fe INFO: 172.20.0.1:44126 - "POST /node/69f687df8234569b79a215fe HTTP/1.0" 202 Accepted 2026-05-04 23:25:40,364 - lava_callback - INFO - Starting async job submit for node 69f687df8234569b79a215fe 2026-05-04 23:25:40,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:40,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f687df8234569b79a215fe HTTP/1.1" 200 None 2026-05-04 23:25:40,379 - lava_callback - DEBUG - Processing node 69f687df8234569b79a215fe: baseline-arm-clabbe 2026-05-04 23:25:40,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f687df8234569b79a215fe 2026-05-04 23:25:40,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:40,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f687df8234569b79a215fe HTTP/1.1" 200 None 2026-05-04 23:25:40,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:40,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:25:40,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:25:40,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f687df8234569b79a215fe HTTP/1.1" 200 None 2026-05-04 23:25:40,432 - lava_callback - ERROR - Error processing callback for node 69f687df8234569b79a215fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50854 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:27:20,487 - lava_callback - INFO - Received callback for node 69f6884c8234569b79a21630 INFO: 172.20.0.1:33586 - "POST /node/69f6884c8234569b79a21630 HTTP/1.0" 202 Accepted 2026-05-04 23:27:20,492 - lava_callback - INFO - Starting async job submit for node 69f6884c8234569b79a21630 2026-05-04 23:27:20,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:27:20,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6884c8234569b79a21630 HTTP/1.1" 200 None 2026-05-04 23:27:20,508 - lava_callback - DEBUG - Processing node 69f6884c8234569b79a21630: baseline-arm-clabbe 2026-05-04 23:27:20,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6884c8234569b79a21630 2026-05-04 23:27:20,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:27:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6884c8234569b79a21630 HTTP/1.1" 200 None 2026-05-04 23:27:20,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:27:20,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:27:20,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:27:20,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6884c8234569b79a21630 HTTP/1.1" 200 None 2026-05-04 23:27:20,578 - lava_callback - ERROR - Error processing callback for node 69f6884c8234569b79a21630: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:29:00,568 - lava_callback - INFO - Received callback for node 69f688ba8234569b79a21669 INFO: 172.20.0.1:44090 - "POST /node/69f688ba8234569b79a21669 HTTP/1.0" 202 Accepted 2026-05-04 23:29:00,573 - lava_callback - INFO - Starting async job submit for node 69f688ba8234569b79a21669 2026-05-04 23:29:00,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:29:00,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f688ba8234569b79a21669 HTTP/1.1" 200 None 2026-05-04 23:29:00,592 - lava_callback - DEBUG - Processing node 69f688ba8234569b79a21669: baseline-arm-clabbe 2026-05-04 23:29:00,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f688ba8234569b79a21669 2026-05-04 23:29:00,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:29:00,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f688ba8234569b79a21669 HTTP/1.1" 200 None 2026-05-04 23:29:00,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:29:00,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:29:00,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:29:00,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f688ba8234569b79a21669 HTTP/1.1" 200 None 2026-05-04 23:29:00,651 - lava_callback - ERROR - Error processing callback for node 69f688ba8234569b79a21669: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58762 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:30:20,599 - lava_callback - INFO - Received callback for node 69f689028234569b79a2168a INFO: 172.20.0.1:59036 - "POST /node/69f689028234569b79a2168a HTTP/1.0" 202 Accepted 2026-05-04 23:30:20,604 - lava_callback - INFO - Starting async job submit for node 69f689028234569b79a2168a 2026-05-04 23:30:20,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:30:20,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f689028234569b79a2168a HTTP/1.1" 200 None 2026-05-04 23:30:20,633 - lava_callback - DEBUG - Processing node 69f689028234569b79a2168a: baseline-arm-clabbe 2026-05-04 23:30:20,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f689028234569b79a2168a 2026-05-04 23:30:20,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:30:20,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f689028234569b79a2168a HTTP/1.1" 200 None 2026-05-04 23:30:20,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:30:20,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:30:20,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:30:20,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f689028234569b79a2168a HTTP/1.1" 200 None 2026-05-04 23:30:20,685 - lava_callback - ERROR - Error processing callback for node 69f689028234569b79a2168a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55950 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:31:40,646 - lava_callback - INFO - Received callback for node 69f6894a8234569b79a216b0 INFO: 172.20.0.1:57792 - "POST /node/69f6894a8234569b79a216b0 HTTP/1.0" 202 Accepted 2026-05-04 23:31:40,651 - lava_callback - INFO - Starting async job submit for node 69f6894a8234569b79a216b0 2026-05-04 23:31:40,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:31:40,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6894a8234569b79a216b0 HTTP/1.1" 200 None 2026-05-04 23:31:40,667 - lava_callback - DEBUG - Processing node 69f6894a8234569b79a216b0: baseline-arm-clabbe 2026-05-04 23:31:40,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6894a8234569b79a216b0 2026-05-04 23:31:40,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:31:40,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6894a8234569b79a216b0 HTTP/1.1" 200 None 2026-05-04 23:31:40,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:31:40,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:31:40,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:31:40,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6894a8234569b79a216b0 HTTP/1.1" 200 None 2026-05-04 23:31:40,711 - lava_callback - ERROR - Error processing callback for node 69f6894a8234569b79a216b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36600 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:32:20,658 - lava_callback - INFO - Received callback for node 69f6896e8234569b79a216c1 INFO: 172.20.0.1:53792 - "POST /node/69f6896e8234569b79a216c1 HTTP/1.0" 202 Accepted 2026-05-04 23:32:20,663 - lava_callback - INFO - Starting async job submit for node 69f6896e8234569b79a216c1 2026-05-04 23:32:20,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:32:20,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6896e8234569b79a216c1 HTTP/1.1" 200 None 2026-05-04 23:32:20,678 - lava_callback - DEBUG - Processing node 69f6896e8234569b79a216c1: baseline-arm-clabbe 2026-05-04 23:32:20,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6896e8234569b79a216c1 2026-05-04 23:32:20,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:32:20,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6896e8234569b79a216c1 HTTP/1.1" 200 None 2026-05-04 23:32:20,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:32:20,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:32:20,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:32:20,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6896e8234569b79a216c1 HTTP/1.1" 200 None 2026-05-04 23:32:20,734 - lava_callback - ERROR - Error processing callback for node 69f6896e8234569b79a216c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:34:00,759 - lava_callback - INFO - Received callback for node 69f689da8234569b79a216fe INFO: 172.20.0.1:55634 - "POST /node/69f689da8234569b79a216fe HTTP/1.0" 202 Accepted 2026-05-04 23:34:00,764 - lava_callback - INFO - Starting async job submit for node 69f689da8234569b79a216fe 2026-05-04 23:34:00,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:34:00,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f689da8234569b79a216fe HTTP/1.1" 200 None 2026-05-04 23:34:00,785 - lava_callback - DEBUG - Processing node 69f689da8234569b79a216fe: baseline-arm-clabbe 2026-05-04 23:34:00,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f689da8234569b79a216fe 2026-05-04 23:34:00,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:34:00,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f689da8234569b79a216fe HTTP/1.1" 200 None 2026-05-04 23:34:00,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:34:00,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:34:00,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:34:00,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f689da8234569b79a216fe HTTP/1.1" 200 None 2026-05-04 23:34:00,838 - lava_callback - ERROR - Error processing callback for node 69f689da8234569b79a216fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40192 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:35:21,013 - lava_callback - INFO - Received callback for node 69f68a228234569b79a21718 INFO: 172.20.0.1:56384 - "POST /node/69f68a228234569b79a21718 HTTP/1.0" 202 Accepted 2026-05-04 23:35:21,018 - lava_callback - INFO - Starting async job submit for node 69f68a228234569b79a21718 2026-05-04 23:35:21,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:21,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68a228234569b79a21718 HTTP/1.1" 200 None 2026-05-04 23:35:21,033 - lava_callback - DEBUG - Processing node 69f68a228234569b79a21718: baseline-arm-clabbe 2026-05-04 23:35:21,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68a228234569b79a21718 2026-05-04 23:35:21,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:21,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68a228234569b79a21718 HTTP/1.1" 200 None 2026-05-04 23:35:21,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:21,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:35:21,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:21,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68a228234569b79a21718 HTTP/1.1" 200 None 2026-05-04 23:35:21,081 - lava_callback - ERROR - Error processing callback for node 69f68a228234569b79a21718: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33068 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:35:40,782 - lava_callback - INFO - Received callback for node 69f68a468234569b79a21728 INFO: 172.20.0.1:33732 - "POST /node/69f68a468234569b79a21728 HTTP/1.0" 202 Accepted 2026-05-04 23:35:40,788 - lava_callback - INFO - Starting async job submit for node 69f68a468234569b79a21728 2026-05-04 23:35:40,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:40,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68a468234569b79a21728 HTTP/1.1" 200 None 2026-05-04 23:35:40,803 - lava_callback - DEBUG - Processing node 69f68a468234569b79a21728: baseline-arm-clabbe 2026-05-04 23:35:40,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68a468234569b79a21728 2026-05-04 23:35:40,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:40,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68a468234569b79a21728 HTTP/1.1" 200 None 2026-05-04 23:35:40,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:40,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:35:40,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:35:40,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68a468234569b79a21728 HTTP/1.1" 200 None 2026-05-04 23:35:40,850 - lava_callback - ERROR - Error processing callback for node 69f68a468234569b79a21728: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46290 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:36:20,821 - lava_callback - INFO - Received callback for node 69f68a6a8234569b79a21738 INFO: 172.20.0.1:51454 - "POST /node/69f68a6a8234569b79a21738 HTTP/1.0" 202 Accepted 2026-05-04 23:36:20,826 - lava_callback - INFO - Starting async job submit for node 69f68a6a8234569b79a21738 2026-05-04 23:36:20,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:36:20,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68a6a8234569b79a21738 HTTP/1.1" 200 None 2026-05-04 23:36:20,841 - lava_callback - DEBUG - Processing node 69f68a6a8234569b79a21738: baseline-arm-clabbe 2026-05-04 23:36:20,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68a6a8234569b79a21738 2026-05-04 23:36:20,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:36:20,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68a6a8234569b79a21738 HTTP/1.1" 200 None 2026-05-04 23:36:20,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:36:20,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:36:20,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:36:20,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68a6a8234569b79a21738 HTTP/1.1" 200 None 2026-05-04 23:36:20,888 - lava_callback - ERROR - Error processing callback for node 69f68a6a8234569b79a21738: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55400 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:38:00,929 - lava_callback - INFO - Received callback for node 69f68ad68234569b79a2176b INFO: 172.20.0.1:46636 - "POST /node/69f68ad68234569b79a2176b HTTP/1.0" 202 Accepted 2026-05-04 23:38:00,934 - lava_callback - INFO - Starting async job submit for node 69f68ad68234569b79a2176b 2026-05-04 23:38:00,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:38:00,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68ad68234569b79a2176b HTTP/1.1" 200 None 2026-05-04 23:38:00,956 - lava_callback - DEBUG - Processing node 69f68ad68234569b79a2176b: baseline-arm-clabbe 2026-05-04 23:38:00,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68ad68234569b79a2176b 2026-05-04 23:38:00,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:38:00,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68ad68234569b79a2176b HTTP/1.1" 200 None 2026-05-04 23:38:00,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:38:00,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de1694b553ffc6903d84 HTTP/1.1" 200 None 2026-05-04 23:38:00,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:38:01,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68ad68234569b79a2176b HTTP/1.1" 200 None 2026-05-04 23:38:01,002 - lava_callback - ERROR - Error processing callback for node 69f68ad68234569b79a2176b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51604 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:39:02,003 - lava_callback - INFO - Received callback for node 69f68b018234569b79a2177b INFO: 172.20.0.1:37234 - "POST /node/69f68b018234569b79a2177b HTTP/1.0" 202 Accepted 2026-05-04 23:39:02,008 - lava_callback - INFO - Starting async job submit for node 69f68b018234569b79a2177b 2026-05-04 23:39:02,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:39:02,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68b018234569b79a2177b HTTP/1.1" 200 None 2026-05-04 23:39:02,030 - lava_callback - DEBUG - Processing node 69f68b018234569b79a2177b: baseline-arm64-baylibre 2026-05-04 23:39:02,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68b018234569b79a2177b 2026-05-04 23:39:02,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:39:02,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68b018234569b79a2177b HTTP/1.1" 200 None 2026-05-04 23:39:02,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:39:02,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:39:02,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:39:02,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68b018234569b79a2177b HTTP/1.1" 200 None 2026-05-04 23:39:02,097 - lava_callback - ERROR - Error processing callback for node 69f68b018234569b79a2177b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:40:20,986 - lava_callback - INFO - Received callback for node 69f68b4f8234569b79a217a7 INFO: 172.20.0.1:58850 - "POST /node/69f68b4f8234569b79a217a7 HTTP/1.0" 202 Accepted 2026-05-04 23:40:20,992 - lava_callback - INFO - Starting async job submit for node 69f68b4f8234569b79a217a7 2026-05-04 23:40:20,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:40:21,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68b4f8234569b79a217a7 HTTP/1.1" 200 None 2026-05-04 23:40:21,008 - lava_callback - DEBUG - Processing node 69f68b4f8234569b79a217a7: baseline-arm64-clabbe 2026-05-04 23:40:21,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68b4f8234569b79a217a7 2026-05-04 23:40:21,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:40:21,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68b4f8234569b79a217a7 HTTP/1.1" 200 None 2026-05-04 23:40:21,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:40:21,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:40:21,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:40:21,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68b4f8234569b79a217a7 HTTP/1.1" 200 None 2026-05-04 23:40:21,068 - lava_callback - ERROR - Error processing callback for node 69f68b4f8234569b79a217a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60192 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:41:21,014 - lava_callback - INFO - Received callback for node 69f68b998234569b79a217cc INFO: 172.20.0.1:39414 - "POST /node/69f68b998234569b79a217cc HTTP/1.0" 202 Accepted 2026-05-04 23:41:21,020 - lava_callback - INFO - Starting async job submit for node 69f68b998234569b79a217cc 2026-05-04 23:41:21,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:41:21,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68b998234569b79a217cc HTTP/1.1" 200 None 2026-05-04 23:41:21,035 - lava_callback - DEBUG - Processing node 69f68b998234569b79a217cc: baseline-arm64-clabbe 2026-05-04 23:41:21,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68b998234569b79a217cc 2026-05-04 23:41:21,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:41:21,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68b998234569b79a217cc HTTP/1.1" 200 None 2026-05-04 23:41:21,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:41:21,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:41:21,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:41:21,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68b998234569b79a217cc HTTP/1.1" 200 None 2026-05-04 23:41:21,083 - lava_callback - ERROR - Error processing callback for node 69f68b998234569b79a217cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35150 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:42:41,047 - lava_callback - INFO - Received callback for node 69f68be38234569b79a217fd INFO: 172.20.0.1:41838 - "POST /node/69f68be38234569b79a217fd HTTP/1.0" 202 Accepted 2026-05-04 23:42:41,055 - lava_callback - INFO - Starting async job submit for node 69f68be38234569b79a217fd 2026-05-04 23:42:41,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:42:41,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68be38234569b79a217fd HTTP/1.1" 200 None 2026-05-04 23:42:41,073 - lava_callback - DEBUG - Processing node 69f68be38234569b79a217fd: baseline-arm64-clabbe 2026-05-04 23:42:41,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68be38234569b79a217fd 2026-05-04 23:42:41,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:42:41,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68be38234569b79a217fd HTTP/1.1" 200 None 2026-05-04 23:42:41,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:42:41,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:42:41,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:42:41,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68be38234569b79a217fd HTTP/1.1" 200 None 2026-05-04 23:42:41,122 - lava_callback - ERROR - Error processing callback for node 69f68be38234569b79a217fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48948 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:43:42,135 - lava_callback - INFO - Received callback for node 69f68c278234569b79a21821 INFO: 172.20.0.1:38498 - "POST /node/69f68c278234569b79a21821 HTTP/1.0" 202 Accepted 2026-05-04 23:43:42,141 - lava_callback - INFO - Starting async job submit for node 69f68c278234569b79a21821 2026-05-04 23:43:42,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:43:42,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68c278234569b79a21821 HTTP/1.1" 200 None 2026-05-04 23:43:42,156 - lava_callback - DEBUG - Processing node 69f68c278234569b79a21821: baseline-arm64-baylibre 2026-05-04 23:43:42,157 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68c278234569b79a21821 2026-05-04 23:43:42,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:43:42,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68c278234569b79a21821 HTTP/1.1" 200 None 2026-05-04 23:43:42,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:43:42,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:43:42,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:43:42,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68c278234569b79a21821 HTTP/1.1" 200 None 2026-05-04 23:43:42,201 - lava_callback - ERROR - Error processing callback for node 69f68c278234569b79a21821: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51066 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:45:01,154 - lava_callback - INFO - Received callback for node 69f68c758234569b79a21853 INFO: 172.20.0.1:34556 - "POST /node/69f68c758234569b79a21853 HTTP/1.0" 202 Accepted 2026-05-04 23:45:01,160 - lava_callback - INFO - Starting async job submit for node 69f68c758234569b79a21853 2026-05-04 23:45:01,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:45:01,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68c758234569b79a21853 HTTP/1.1" 200 None 2026-05-04 23:45:01,175 - lava_callback - DEBUG - Processing node 69f68c758234569b79a21853: baseline-arm64-clabbe 2026-05-04 23:45:01,175 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68c758234569b79a21853 2026-05-04 23:45:01,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:45:01,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68c758234569b79a21853 HTTP/1.1" 200 None 2026-05-04 23:45:01,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:45:01,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:45:01,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:45:01,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68c758234569b79a21853 HTTP/1.1" 200 None 2026-05-04 23:45:01,222 - lava_callback - ERROR - Error processing callback for node 69f68c758234569b79a21853: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38932 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:46:21,200 - lava_callback - INFO - Received callback for node 69f68cbe8234569b79a21873 INFO: 172.20.0.1:52306 - "POST /node/69f68cbe8234569b79a21873 HTTP/1.0" 202 Accepted 2026-05-04 23:46:21,206 - lava_callback - INFO - Starting async job submit for node 69f68cbe8234569b79a21873 2026-05-04 23:46:21,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:46:21,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68cbe8234569b79a21873 HTTP/1.1" 200 None 2026-05-04 23:46:21,236 - lava_callback - DEBUG - Processing node 69f68cbe8234569b79a21873: baseline-arm64-clabbe 2026-05-04 23:46:21,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68cbe8234569b79a21873 2026-05-04 23:46:21,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:46:21,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68cbe8234569b79a21873 HTTP/1.1" 200 None 2026-05-04 23:46:21,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:46:21,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:46:21,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:46:21,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68cbe8234569b79a21873 HTTP/1.1" 200 None 2026-05-04 23:46:21,297 - lava_callback - ERROR - Error processing callback for node 69f68cbe8234569b79a21873: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43956 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:47:41,282 - lava_callback - INFO - Received callback for node 69f68d088234569b79a218aa INFO: 172.20.0.1:48848 - "POST /node/69f68d088234569b79a218aa HTTP/1.0" 202 Accepted 2026-05-04 23:47:41,288 - lava_callback - INFO - Starting async job submit for node 69f68d088234569b79a218aa 2026-05-04 23:47:41,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:47:41,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68d088234569b79a218aa HTTP/1.1" 200 None 2026-05-04 23:47:41,307 - lava_callback - DEBUG - Processing node 69f68d088234569b79a218aa: baseline-arm64-clabbe 2026-05-04 23:47:41,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68d088234569b79a218aa 2026-05-04 23:47:41,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:47:41,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68d088234569b79a218aa HTTP/1.1" 200 None 2026-05-04 23:47:41,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:47:41,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:47:41,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:47:41,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68d088234569b79a218aa HTTP/1.1" 200 None 2026-05-04 23:47:41,352 - lava_callback - ERROR - Error processing callback for node 69f68d088234569b79a218aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:50:01,404 - lava_callback - INFO - Received callback for node 69f68d998234569b79a218ef INFO: 172.20.0.1:32948 - "POST /node/69f68d998234569b79a218ef HTTP/1.0" 202 Accepted 2026-05-04 23:50:01,410 - lava_callback - INFO - Starting async job submit for node 69f68d998234569b79a218ef 2026-05-04 23:50:01,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:50:01,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68d998234569b79a218ef HTTP/1.1" 200 None 2026-05-04 23:50:01,425 - lava_callback - DEBUG - Processing node 69f68d998234569b79a218ef: baseline-arm64-clabbe 2026-05-04 23:50:01,425 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68d998234569b79a218ef 2026-05-04 23:50:01,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:50:01,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68d998234569b79a218ef HTTP/1.1" 200 None 2026-05-04 23:50:01,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:50:01,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:50:01,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:50:01,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68d998234569b79a218ef HTTP/1.1" 200 None 2026-05-04 23:50:01,473 - lava_callback - ERROR - Error processing callback for node 69f68d998234569b79a218ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34112 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:51:01,425 - lava_callback - INFO - Received callback for node 69f68de28234569b79a2191f INFO: 172.20.0.1:56402 - "POST /node/69f68de28234569b79a2191f HTTP/1.0" 202 Accepted 2026-05-04 23:51:01,431 - lava_callback - INFO - Starting async job submit for node 69f68de28234569b79a2191f 2026-05-04 23:51:01,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:51:01,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68de28234569b79a2191f HTTP/1.1" 200 None 2026-05-04 23:51:01,446 - lava_callback - DEBUG - Processing node 69f68de28234569b79a2191f: baseline-arm64-clabbe 2026-05-04 23:51:01,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68de28234569b79a2191f 2026-05-04 23:51:01,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:51:01,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68de28234569b79a2191f HTTP/1.1" 200 None 2026-05-04 23:51:01,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:51:01,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:51:01,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:51:01,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68de28234569b79a2191f HTTP/1.1" 200 None 2026-05-04 23:51:01,493 - lava_callback - ERROR - Error processing callback for node 69f68de28234569b79a2191f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:52:21,478 - lava_callback - INFO - Received callback for node 69f68e2d8234569b79a21940 INFO: 172.20.0.1:45088 - "POST /node/69f68e2d8234569b79a21940 HTTP/1.0" 202 Accepted 2026-05-04 23:52:21,484 - lava_callback - INFO - Starting async job submit for node 69f68e2d8234569b79a21940 2026-05-04 23:52:21,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:52:21,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68e2d8234569b79a21940 HTTP/1.1" 200 None 2026-05-04 23:52:21,506 - lava_callback - DEBUG - Processing node 69f68e2d8234569b79a21940: baseline-arm64-clabbe 2026-05-04 23:52:21,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68e2d8234569b79a21940 2026-05-04 23:52:21,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:52:21,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68e2d8234569b79a21940 HTTP/1.1" 200 None 2026-05-04 23:52:21,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:52:21,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:52:21,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:52:21,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68e2d8234569b79a21940 HTTP/1.1" 200 None 2026-05-04 23:52:21,554 - lava_callback - ERROR - Error processing callback for node 69f68e2d8234569b79a21940: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43004 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:53:41,509 - lava_callback - INFO - Received callback for node 69f68e778234569b79a21971 INFO: 172.20.0.1:54820 - "POST /node/69f68e778234569b79a21971 HTTP/1.0" 202 Accepted 2026-05-04 23:53:41,515 - lava_callback - INFO - Starting async job submit for node 69f68e778234569b79a21971 2026-05-04 23:53:41,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:53:41,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68e778234569b79a21971 HTTP/1.1" 200 None 2026-05-04 23:53:41,537 - lava_callback - DEBUG - Processing node 69f68e778234569b79a21971: baseline-arm64-clabbe 2026-05-04 23:53:41,537 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68e778234569b79a21971 2026-05-04 23:53:41,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:53:41,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68e778234569b79a21971 HTTP/1.1" 200 None 2026-05-04 23:53:41,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:53:41,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:53:41,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:53:41,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68e778234569b79a21971 HTTP/1.1" 200 None 2026-05-04 23:53:41,583 - lava_callback - ERROR - Error processing callback for node 69f68e778234569b79a21971: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56954 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:56:01,599 - lava_callback - INFO - Received callback for node 69f68f098234569b79a219c4 INFO: 172.20.0.1:37010 - "POST /node/69f68f098234569b79a219c4 HTTP/1.0" 202 Accepted 2026-05-04 23:56:01,605 - lava_callback - INFO - Starting async job submit for node 69f68f098234569b79a219c4 2026-05-04 23:56:01,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:56:01,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68f098234569b79a219c4 HTTP/1.1" 200 None 2026-05-04 23:56:01,620 - lava_callback - DEBUG - Processing node 69f68f098234569b79a219c4: baseline-arm64-clabbe 2026-05-04 23:56:01,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68f098234569b79a219c4 2026-05-04 23:56:01,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:56:01,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68f098234569b79a219c4 HTTP/1.1" 200 None 2026-05-04 23:56:01,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:56:01,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:56:01,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:56:01,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68f098234569b79a219c4 HTTP/1.1" 200 None 2026-05-04 23:56:01,671 - lava_callback - ERROR - Error processing callback for node 69f68f098234569b79a219c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44664 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:57:21,680 - lava_callback - INFO - Received callback for node 69f68f528234569b79a219e6 INFO: 172.20.0.1:33806 - "POST /node/69f68f528234569b79a219e6 HTTP/1.0" 202 Accepted 2026-05-04 23:57:21,687 - lava_callback - INFO - Starting async job submit for node 69f68f528234569b79a219e6 2026-05-04 23:57:21,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:57:21,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68f528234569b79a219e6 HTTP/1.1" 200 None 2026-05-04 23:57:21,715 - lava_callback - DEBUG - Processing node 69f68f528234569b79a219e6: baseline-arm64-clabbe 2026-05-04 23:57:21,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68f528234569b79a219e6 2026-05-04 23:57:21,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:57:21,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68f528234569b79a219e6 HTTP/1.1" 200 None 2026-05-04 23:57:21,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:57:21,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f380b82fa6ff8e8ca8e0a6 HTTP/1.1" 200 None 2026-05-04 23:57:21,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:57:21,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68f528234569b79a219e6 HTTP/1.1" 200 None 2026-05-04 23:57:21,804 - lava_callback - ERROR - Error processing callback for node 69f68f528234569b79a219e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53920 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:58:22,850 - lava_callback - INFO - Received callback for node 69f68f928234569b79a21a0c INFO: 172.20.0.1:49772 - "POST /node/69f68f928234569b79a21a0c HTTP/1.0" 202 Accepted 2026-05-04 23:58:22,856 - lava_callback - INFO - Starting async job submit for node 69f68f928234569b79a21a0c 2026-05-04 23:58:22,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:58:22,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68f928234569b79a21a0c HTTP/1.1" 200 None 2026-05-04 23:58:22,894 - lava_callback - DEBUG - Processing node 69f68f928234569b79a21a0c: baseline-arm64-baylibre 2026-05-04 23:58:22,894 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68f928234569b79a21a0c 2026-05-04 23:58:22,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:58:22,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68f928234569b79a21a0c HTTP/1.1" 200 None 2026-05-04 23:58:22,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:58:22,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 23:58:22,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:58:23,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68f928234569b79a21a0c HTTP/1.1" 200 None 2026-05-04 23:58:23,002 - lava_callback - ERROR - Error processing callback for node 69f68f928234569b79a21a0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41750 - "GET / HTTP/1.0" 200 OK 2026-05-04 23:59:43,054 - lava_callback - INFO - Received callback for node 69f68fda8234569b79a21a3e INFO: 172.20.0.1:45834 - "POST /node/69f68fda8234569b79a21a3e HTTP/1.0" 202 Accepted 2026-05-04 23:59:43,059 - lava_callback - INFO - Starting async job submit for node 69f68fda8234569b79a21a3e 2026-05-04 23:59:43,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:59:43,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68fda8234569b79a21a3e HTTP/1.1" 200 None 2026-05-04 23:59:43,075 - lava_callback - DEBUG - Processing node 69f68fda8234569b79a21a3e: baseline-arm64-baylibre 2026-05-04 23:59:43,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f68fda8234569b79a21a3e 2026-05-04 23:59:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:59:43,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f68fda8234569b79a21a3e HTTP/1.1" 200 None 2026-05-04 23:59:43,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:59:43,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-04 23:59:43,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-04 23:59:43,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f68fda8234569b79a21a3e HTTP/1.1" 200 None 2026-05-04 23:59:43,129 - lava_callback - ERROR - Error processing callback for node 69f68fda8234569b79a21a3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK 2026-05-05 00:02:03,125 - lava_callback - INFO - Received callback for node 69f690728234569b79a21a8c INFO: 172.20.0.1:51866 - "POST /node/69f690728234569b79a21a8c HTTP/1.0" 202 Accepted 2026-05-05 00:02:03,131 - lava_callback - INFO - Starting async job submit for node 69f690728234569b79a21a8c 2026-05-05 00:02:03,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:02:03,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f690728234569b79a21a8c HTTP/1.1" 200 None 2026-05-05 00:02:03,147 - lava_callback - DEBUG - Processing node 69f690728234569b79a21a8c: baseline-arm64-baylibre 2026-05-05 00:02:03,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f690728234569b79a21a8c 2026-05-05 00:02:03,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:02:03,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f690728234569b79a21a8c HTTP/1.1" 200 None 2026-05-05 00:02:03,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:02:03,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-05 00:02:03,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:02:03,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f690728234569b79a21a8c HTTP/1.1" 200 None 2026-05-05 00:02:03,194 - lava_callback - ERROR - Error processing callback for node 69f690728234569b79a21a8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET / HTTP/1.0" 200 OK 2026-05-05 00:05:43,287 - lava_callback - INFO - Received callback for node 69f6914d8234569b79a21af8 INFO: 172.20.0.1:58412 - "POST /node/69f6914d8234569b79a21af8 HTTP/1.0" 202 Accepted 2026-05-05 00:05:43,293 - lava_callback - INFO - Starting async job submit for node 69f6914d8234569b79a21af8 2026-05-05 00:05:43,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:05:43,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6914d8234569b79a21af8 HTTP/1.1" 200 None 2026-05-05 00:05:43,308 - lava_callback - DEBUG - Processing node 69f6914d8234569b79a21af8: baseline-arm64-baylibre 2026-05-05 00:05:43,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f6914d8234569b79a21af8 2026-05-05 00:05:43,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:05:43,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f6914d8234569b79a21af8 HTTP/1.1" 200 None 2026-05-05 00:05:43,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:05:43,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-05 00:05:43,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:05:43,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f6914d8234569b79a21af8 HTTP/1.1" 200 None 2026-05-05 00:05:43,362 - lava_callback - ERROR - Error processing callback for node 69f6914d8234569b79a21af8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47944 - "GET / HTTP/1.0" 200 OK 2026-05-05 00:08:03,426 - lava_callback - INFO - Received callback for node 69f691e18234569b79a21b49 INFO: 172.20.0.1:56938 - "POST /node/69f691e18234569b79a21b49 HTTP/1.0" 202 Accepted 2026-05-05 00:08:03,432 - lava_callback - INFO - Starting async job submit for node 69f691e18234569b79a21b49 2026-05-05 00:08:03,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:08:03,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f691e18234569b79a21b49 HTTP/1.1" 200 None 2026-05-05 00:08:03,448 - lava_callback - DEBUG - Processing node 69f691e18234569b79a21b49: baseline-arm64-baylibre 2026-05-05 00:08:03,448 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f691e18234569b79a21b49 2026-05-05 00:08:03,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:08:03,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f691e18234569b79a21b49 HTTP/1.1" 200 None 2026-05-05 00:08:03,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:08:03,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-05 00:08:03,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:08:03,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f691e18234569b79a21b49 HTTP/1.1" 200 None 2026-05-05 00:08:03,494 - lava_callback - ERROR - Error processing callback for node 69f691e18234569b79a21b49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47332 - "GET / HTTP/1.0" 200 OK 2026-05-05 00:10:43,575 - lava_callback - INFO - Received callback for node 69f692768234569b79a21b9b INFO: 172.20.0.1:46224 - "POST /node/69f692768234569b79a21b9b HTTP/1.0" 202 Accepted 2026-05-05 00:10:43,581 - lava_callback - INFO - Starting async job submit for node 69f692768234569b79a21b9b 2026-05-05 00:10:43,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:10:43,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f692768234569b79a21b9b HTTP/1.1" 200 None 2026-05-05 00:10:43,604 - lava_callback - DEBUG - Processing node 69f692768234569b79a21b9b: baseline-arm64-baylibre 2026-05-05 00:10:43,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f692768234569b79a21b9b 2026-05-05 00:10:43,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:10:43,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f692768234569b79a21b9b HTTP/1.1" 200 None 2026-05-05 00:10:43,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:10:43,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-05 00:10:43,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:10:43,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f692768234569b79a21b9b HTTP/1.1" 200 None 2026-05-05 00:10:43,659 - lava_callback - ERROR - Error processing callback for node 69f692768234569b79a21b9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54374 - "GET / HTTP/1.0" 200 OK 2026-05-05 00:12:03,622 - lava_callback - INFO - Received callback for node 69f692c18234569b79a21bc0 INFO: 172.20.0.1:44994 - "POST /node/69f692c18234569b79a21bc0 HTTP/1.0" 202 Accepted 2026-05-05 00:12:03,629 - lava_callback - INFO - Starting async job submit for node 69f692c18234569b79a21bc0 2026-05-05 00:12:03,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:12:03,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f692c18234569b79a21bc0 HTTP/1.1" 200 None 2026-05-05 00:12:03,643 - lava_callback - DEBUG - Processing node 69f692c18234569b79a21bc0: baseline-arm64-baylibre 2026-05-05 00:12:03,643 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69f692c18234569b79a21bc0 2026-05-05 00:12:03,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:12:03,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f692c18234569b79a21bc0 HTTP/1.1" 200 None 2026-05-05 00:12:03,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:12:03,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f0de2994b553ffc6903d97 HTTP/1.1" 200 None 2026-05-05 00:12:03,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-05 00:12:03,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69f692c18234569b79a21bc0 HTTP/1.1" 200 None 2026-05-05 00:12:03,690 - lava_callback - ERROR - Error processing callback for node 69f692c18234569b79a21bc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47104 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]