INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.19.0.1:33256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58014 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:32:51,015 - lava_callback - INFO - Received callback for node 69c16a422b2b51e9ad97798f 2026-03-23 16:32:51,021 - lava_callback - INFO - Starting async job submit for node 69c16a422b2b51e9ad97798f INFO: 172.19.0.1:47612 - "POST /node/69c16a422b2b51e9ad97798f HTTP/1.0" 202 Accepted 2026-03-23 16:32:51,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:32:51,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16a422b2b51e9ad97798f HTTP/1.1" 200 None 2026-03-23 16:32:51,068 - lava_callback - DEBUG - Processing node 69c16a422b2b51e9ad97798f: baseline-arm 2026-03-23 16:32:51,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:32:51,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:32:51,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c16a422b2b51e9ad97798f/log.txt.gz 2026-03-23 16:32:51,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:32:51,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:32:51,765 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16a422b2b51e9ad97798f/lava-logs.yaml 2026-03-23 16:32:51,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:32:51,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:32:51,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16a422b2b51e9ad97798f/lava_callback.json.gz 2026-03-23 16:32:51,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:32:51,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16a422b2b51e9ad97798f HTTP/1.1" 200 None 2026-03-23 16:32:51,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:32:52,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1678e2b2b51e9ad97794c HTTP/1.1" 200 None 2026-03-23 16:32:52,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:32:52,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16a422b2b51e9ad97798f HTTP/1.1" 200 None 2026-03-23 16:32:52,057 - lava_callback - INFO - Completed processing callback for node 69c16a422b2b51e9ad97798f INFO: 172.19.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59058 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:33:22,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:33:22,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49168 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:39:21,208 - lava_callback - INFO - Received callback for node 69c16ca22b2b51e9ad97a073 INFO: 172.19.0.1:56658 - "POST /node/69c16ca22b2b51e9ad97a073 HTTP/1.0" 202 Accepted 2026-03-23 16:39:21,218 - lava_callback - INFO - Starting async job submit for node 69c16ca22b2b51e9ad97a073 2026-03-23 16:39:21,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:21,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca22b2b51e9ad97a073 HTTP/1.1" 200 None 2026-03-23 16:39:21,247 - lava_callback - DEBUG - Processing node 69c16ca22b2b51e9ad97a073: baseline-arm 2026-03-23 16:39:21,252 - lava_callback - WARNING - Failed to upload log 2026-03-23 16:39:21,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:21,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:21,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca22b2b51e9ad97a073/lava-logs.yaml 2026-03-23 16:39:21,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:21,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:21,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca22b2b51e9ad97a073/lava_callback.json.gz 2026-03-23 16:39:21,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:21,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca22b2b51e9ad97a073 HTTP/1.1" 200 None 2026-03-23 16:39:21,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:21,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:39:21,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:21,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca22b2b51e9ad97a073 HTTP/1.1" 200 None 2026-03-23 16:39:21,591 - lava_callback - INFO - Completed processing callback for node 69c16ca22b2b51e9ad97a073 2026-03-23 16:39:22,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:22,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56670 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:39:29,750 - lava_callback - INFO - Received callback for node 69c16ca62b2b51e9ad97a07f INFO: 172.19.0.1:55692 - "POST /node/69c16ca62b2b51e9ad97a07f HTTP/1.0" 202 Accepted 2026-03-23 16:39:29,798 - lava_callback - INFO - Starting async job submit for node 69c16ca62b2b51e9ad97a07f 2026-03-23 16:39:29,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:29,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca62b2b51e9ad97a07f HTTP/1.1" 200 None 2026-03-23 16:39:29,834 - lava_callback - DEBUG - Processing node 69c16ca62b2b51e9ad97a07f: baseline-arm 2026-03-23 16:39:29,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:30,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:30,143 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca62b2b51e9ad97a07f/log.txt.gz 2026-03-23 16:39:30,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:30,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:30,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca62b2b51e9ad97a07f/lava-logs.yaml 2026-03-23 16:39:30,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:30,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:30,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca62b2b51e9ad97a07f/lava_callback.json.gz 2026-03-23 16:39:30,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:30,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca62b2b51e9ad97a07f HTTP/1.1" 200 None 2026-03-23 16:39:30,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:30,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:39:30,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:30,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca62b2b51e9ad97a07f HTTP/1.1" 200 None 2026-03-23 16:39:30,699 - lava_callback - INFO - Completed processing callback for node 69c16ca62b2b51e9ad97a07f INFO: 172.19.0.1:55702 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:39:39,201 - lava_callback - INFO - Received callback for node 69c16ca32b2b51e9ad97a076 INFO: 172.19.0.1:55716 - "POST /node/69c16ca32b2b51e9ad97a076 HTTP/1.0" 202 Accepted 2026-03-23 16:39:39,251 - lava_callback - INFO - Starting async job submit for node 69c16ca32b2b51e9ad97a076 2026-03-23 16:39:39,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:39,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca32b2b51e9ad97a076 HTTP/1.1" 200 None 2026-03-23 16:39:39,299 - lava_callback - DEBUG - Processing node 69c16ca32b2b51e9ad97a076: baseline-arm 2026-03-23 16:39:39,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:39,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:39,600 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca32b2b51e9ad97a076/log.txt.gz 2026-03-23 16:39:39,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:39,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:39,861 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca32b2b51e9ad97a076/lava-logs.yaml 2026-03-23 16:39:39,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:39:39,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:39:39,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca32b2b51e9ad97a076/lava_callback.json.gz 2026-03-23 16:39:40,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:40,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca32b2b51e9ad97a076 HTTP/1.1" 200 None 2026-03-23 16:39:40,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:40,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:39:40,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:40,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca32b2b51e9ad97a076 HTTP/1.1" 200 None 2026-03-23 16:39:40,079 - lava_callback - INFO - Completed processing callback for node 69c16ca32b2b51e9ad97a076 INFO: 172.19.0.1:53662 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:39:52,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:39:52,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37902 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:40:27,158 - lava_callback - INFO - Received callback for node 69bec9f8a85a0f2cbb32ce45 INFO: 172.19.0.1:37908 - "POST /node/69bec9f8a85a0f2cbb32ce45 HTTP/1.0" 202 Accepted 2026-03-23 16:40:27,165 - lava_callback - INFO - Starting async job submit for node 69bec9f8a85a0f2cbb32ce45 2026-03-23 16:40:27,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:27,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec9f8a85a0f2cbb32ce45 HTTP/1.1" 200 None 2026-03-23 16:40:27,191 - lava_callback - DEBUG - Processing node 69bec9f8a85a0f2cbb32ce45: baseline-arm64-baylibre 2026-03-23 16:40:27,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bec9f8a85a0f2cbb32ce45 2026-03-23 16:40:27,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:27,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec9f8a85a0f2cbb32ce45 HTTP/1.1" 200 None 2026-03-23 16:40:27,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:27,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:40:27,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:27,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bec9f8a85a0f2cbb32ce45 HTTP/1.1" 200 None 2026-03-23 16:40:27,261 - lava_callback - ERROR - Error processing callback for node 69bec9f8a85a0f2cbb32ce45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:40:33,620 - lava_callback - INFO - Received callback for node 69c16ca22b2b51e9ad97a070 INFO: 172.19.0.1:44276 - "POST /node/69c16ca22b2b51e9ad97a070 HTTP/1.0" 202 Accepted 2026-03-23 16:40:33,627 - lava_callback - INFO - Starting async job submit for node 69c16ca22b2b51e9ad97a070 2026-03-23 16:40:33,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:33,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca22b2b51e9ad97a070 HTTP/1.1" 200 None 2026-03-23 16:40:33,672 - lava_callback - DEBUG - Processing node 69c16ca22b2b51e9ad97a070: baseline-arm 2026-03-23 16:40:33,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:34,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:34,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca22b2b51e9ad97a070/log.txt.gz 2026-03-23 16:40:34,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:34,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:34,492 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca22b2b51e9ad97a070/lava-logs.yaml 2026-03-23 16:40:34,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:34,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:34,685 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca22b2b51e9ad97a070/lava_callback.json.gz 2026-03-23 16:40:34,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:34,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca22b2b51e9ad97a070 HTTP/1.1" 200 None 2026-03-23 16:40:34,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:34,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:40:34,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:34,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca22b2b51e9ad97a070 HTTP/1.1" 200 None 2026-03-23 16:40:34,783 - lava_callback - INFO - Completed processing callback for node 69c16ca22b2b51e9ad97a070 2026-03-23 16:40:35,469 - lava_callback - INFO - Received callback for node 69c16cc92b2b51e9ad97a0f5 INFO: 172.19.0.1:44286 - "POST /node/69c16cc92b2b51e9ad97a0f5 HTTP/1.0" 202 Accepted 2026-03-23 16:40:35,520 - lava_callback - INFO - Starting async job submit for node 69c16cc92b2b51e9ad97a0f5 2026-03-23 16:40:35,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:35,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc92b2b51e9ad97a0f5 HTTP/1.1" 200 None 2026-03-23 16:40:35,621 - lava_callback - DEBUG - Processing node 69c16cc92b2b51e9ad97a0f5: baseline-arm-pengutronix 2026-03-23 16:40:35,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:35,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:35,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc92b2b51e9ad97a0f5/log.txt.gz 2026-03-23 16:40:36,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:36,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:36,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc92b2b51e9ad97a0f5/lava-logs.yaml 2026-03-23 16:40:36,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:36,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:36,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc92b2b51e9ad97a0f5/lava_callback.json.gz 2026-03-23 16:40:36,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:36,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc92b2b51e9ad97a0f5 HTTP/1.1" 200 None 2026-03-23 16:40:36,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:36,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:40:36,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:36,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cc92b2b51e9ad97a0f5 HTTP/1.1" 200 None 2026-03-23 16:40:36,461 - lava_callback - INFO - Completed processing callback for node 69c16cc92b2b51e9ad97a0f5 INFO: 172.19.0.1:44290 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:40:40,987 - lava_callback - INFO - Received callback for node 69c16cc62b2b51e9ad97a0ef INFO: 172.19.0.1:50542 - "POST /node/69c16cc62b2b51e9ad97a0ef HTTP/1.0" 202 Accepted 2026-03-23 16:40:40,994 - lava_callback - INFO - Starting async job submit for node 69c16cc62b2b51e9ad97a0ef 2026-03-23 16:40:41,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:41,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc62b2b51e9ad97a0ef HTTP/1.1" 200 None 2026-03-23 16:40:41,043 - lava_callback - DEBUG - Processing node 69c16cc62b2b51e9ad97a0ef: baseline-arm-pengutronix 2026-03-23 16:40:41,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:41,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:41,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc62b2b51e9ad97a0ef/log.txt.gz 2026-03-23 16:40:41,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:41,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:41,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc62b2b51e9ad97a0ef/lava-logs.yaml 2026-03-23 16:40:41,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:41,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:41,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc62b2b51e9ad97a0ef/lava_callback.json.gz 2026-03-23 16:40:41,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:41,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc62b2b51e9ad97a0ef HTTP/1.1" 200 None 2026-03-23 16:40:41,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:41,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:40:41,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:41,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cc62b2b51e9ad97a0ef HTTP/1.1" 200 None 2026-03-23 16:40:41,948 - lava_callback - INFO - Completed processing callback for node 69c16cc62b2b51e9ad97a0ef INFO: 172.19.0.1:50550 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:40:47,439 - lava_callback - INFO - Received callback for node 69c16ca52b2b51e9ad97a07c INFO: 172.19.0.1:50558 - "POST /node/69c16ca52b2b51e9ad97a07c HTTP/1.0" 202 Accepted 2026-03-23 16:40:47,446 - lava_callback - INFO - Starting async job submit for node 69c16ca52b2b51e9ad97a07c 2026-03-23 16:40:47,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:47,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca52b2b51e9ad97a07c HTTP/1.1" 200 None 2026-03-23 16:40:47,492 - lava_callback - DEBUG - Processing node 69c16ca52b2b51e9ad97a07c: baseline-arm 2026-03-23 16:40:47,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:47,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:47,928 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca52b2b51e9ad97a07c/log.txt.gz 2026-03-23 16:40:48,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:48,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:48,307 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca52b2b51e9ad97a07c/lava-logs.yaml 2026-03-23 16:40:48,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:48,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:48,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca52b2b51e9ad97a07c/lava_callback.json.gz 2026-03-23 16:40:48,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:48,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca52b2b51e9ad97a07c HTTP/1.1" 200 None 2026-03-23 16:40:48,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:48,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:40:48,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:48,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca52b2b51e9ad97a07c HTTP/1.1" 200 None 2026-03-23 16:40:48,540 - lava_callback - INFO - Completed processing callback for node 69c16ca52b2b51e9ad97a07c 2026-03-23 16:40:51,360 - lava_callback - INFO - Received callback for node 69c16cb42b2b51e9ad97a0af INFO: 172.19.0.1:43738 - "POST /node/69c16cb42b2b51e9ad97a0af HTTP/1.0" 202 Accepted 2026-03-23 16:40:51,368 - lava_callback - INFO - Starting async job submit for node 69c16cb42b2b51e9ad97a0af 2026-03-23 16:40:51,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:51,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb42b2b51e9ad97a0af HTTP/1.1" 200 None 2026-03-23 16:40:51,413 - lava_callback - DEBUG - Processing node 69c16cb42b2b51e9ad97a0af: baseline-arm-broonie 2026-03-23 16:40:51,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:51,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:51,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb42b2b51e9ad97a0af/log.txt.gz 2026-03-23 16:40:51,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:52,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:52,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 16:40:52,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:52,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb42b2b51e9ad97a0af/lava-logs.yaml 2026-03-23 16:40:52,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:52,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:52,378 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb42b2b51e9ad97a0af/lava_callback.json.gz 2026-03-23 16:40:52,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:52,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb42b2b51e9ad97a0af HTTP/1.1" 200 None 2026-03-23 16:40:52,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:52,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:40:52,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:52,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cb42b2b51e9ad97a0af HTTP/1.1" 200 None 2026-03-23 16:40:52,514 - lava_callback - INFO - Completed processing callback for node 69c16cb42b2b51e9ad97a0af 2026-03-23 16:40:52,861 - lava_callback - INFO - Received callback for node 69c16cb52b2b51e9ad97a0b2 INFO: 172.19.0.1:43746 - "POST /node/69c16cb52b2b51e9ad97a0b2 HTTP/1.0" 202 Accepted 2026-03-23 16:40:52,870 - lava_callback - INFO - Starting async job submit for node 69c16cb52b2b51e9ad97a0b2 2026-03-23 16:40:52,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:52,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb52b2b51e9ad97a0b2 HTTP/1.1" 200 None 2026-03-23 16:40:52,932 - lava_callback - DEBUG - Processing node 69c16cb52b2b51e9ad97a0b2: baseline-arm-broonie 2026-03-23 16:40:53,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:53,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:53,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb52b2b51e9ad97a0b2/log.txt.gz 2026-03-23 16:40:53,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:53,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:53,656 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb52b2b51e9ad97a0b2/lava-logs.yaml 2026-03-23 16:40:53,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:53,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:53,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb52b2b51e9ad97a0b2/lava_callback.json.gz 2026-03-23 16:40:53,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:53,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb52b2b51e9ad97a0b2 HTTP/1.1" 200 None 2026-03-23 16:40:53,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:53,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:40:53,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:53,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cb52b2b51e9ad97a0b2 HTTP/1.1" 200 None 2026-03-23 16:40:53,928 - lava_callback - INFO - Completed processing callback for node 69c16cb52b2b51e9ad97a0b2 INFO: 172.19.0.1:43762 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:40:58,034 - lava_callback - INFO - Received callback for node 69c16cba2b2b51e9ad97a0c7 INFO: 172.19.0.1:43774 - "POST /node/69c16cba2b2b51e9ad97a0c7 HTTP/1.0" 202 Accepted 2026-03-23 16:40:58,042 - lava_callback - INFO - Starting async job submit for node 69c16cba2b2b51e9ad97a0c7 2026-03-23 16:40:58,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:58,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cba2b2b51e9ad97a0c7 HTTP/1.1" 200 None 2026-03-23 16:40:58,085 - lava_callback - DEBUG - Processing node 69c16cba2b2b51e9ad97a0c7: baseline-arm-clabbe 2026-03-23 16:40:58,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:58,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:58,452 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cba2b2b51e9ad97a0c7/log.txt.gz 2026-03-23 16:40:58,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:58,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:58,830 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cba2b2b51e9ad97a0c7/lava-logs.yaml 2026-03-23 16:40:58,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:40:58,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:40:58,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cba2b2b51e9ad97a0c7/lava_callback.json.gz 2026-03-23 16:40:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:59,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cba2b2b51e9ad97a0c7 HTTP/1.1" 200 None 2026-03-23 16:40:59,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:59,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:40:59,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:40:59,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cba2b2b51e9ad97a0c7 HTTP/1.1" 200 None 2026-03-23 16:40:59,131 - lava_callback - INFO - Completed processing callback for node 69c16cba2b2b51e9ad97a0c7 INFO: 172.19.0.1:46692 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:41:02,595 - lava_callback - INFO - Received callback for node 69c16cb62b2b51e9ad97a0b5 INFO: 172.19.0.1:46702 - "POST /node/69c16cb62b2b51e9ad97a0b5 HTTP/1.0" 202 Accepted 2026-03-23 16:41:02,606 - lava_callback - INFO - Starting async job submit for node 69c16cb62b2b51e9ad97a0b5 2026-03-23 16:41:02,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:02,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb62b2b51e9ad97a0b5 HTTP/1.1" 200 None 2026-03-23 16:41:02,651 - lava_callback - DEBUG - Processing node 69c16cb62b2b51e9ad97a0b5: baseline-arm-broonie 2026-03-23 16:41:02,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:03,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:03,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb62b2b51e9ad97a0b5/log.txt.gz 2026-03-23 16:41:03,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:03,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:03,479 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb62b2b51e9ad97a0b5/lava-logs.yaml 2026-03-23 16:41:03,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:03,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:03,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69c16cb62b2b51e9ad97a0b5/lava_callback.json.gz 2026-03-23 16:41:03,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:03,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cb62b2b51e9ad97a0b5 HTTP/1.1" 200 None 2026-03-23 16:41:03,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:03,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:41:03,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:03,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cb62b2b51e9ad97a0b5 HTTP/1.1" 200 None 2026-03-23 16:41:03,755 - lava_callback - INFO - Completed processing callback for node 69c16cb62b2b51e9ad97a0b5 INFO: 172.19.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47836 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:41:22,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:22,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:36254 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:41:30,528 - lava_callback - INFO - Received callback for node 69c16d272b2b51e9ad97a203 INFO: 172.19.0.1:48028 - "POST /node/69c16d272b2b51e9ad97a203 HTTP/1.0" 202 Accepted 2026-03-23 16:41:30,537 - lava_callback - INFO - Starting async job submit for node 69c16d272b2b51e9ad97a203 2026-03-23 16:41:30,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:30,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16d272b2b51e9ad97a203 HTTP/1.1" 200 None 2026-03-23 16:41:30,561 - lava_callback - DEBUG - Processing node 69c16d272b2b51e9ad97a203: baseline-arm 2026-03-23 16:41:30,567 - lava_callback - WARNING - Failed to upload log 2026-03-23 16:41:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:30,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:30,705 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16d272b2b51e9ad97a203/lava-logs.yaml 2026-03-23 16:41:30,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:30,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:30,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16d272b2b51e9ad97a203/lava_callback.json.gz 2026-03-23 16:41:30,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:30,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16d272b2b51e9ad97a203 HTTP/1.1" 200 None 2026-03-23 16:41:30,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:30,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:41:30,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:30,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16d272b2b51e9ad97a203 HTTP/1.1" 200 None 2026-03-23 16:41:30,950 - lava_callback - INFO - Completed processing callback for node 69c16d272b2b51e9ad97a203 INFO: 172.19.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41238 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:41:52,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:52,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60132 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:41:57,592 - lava_callback - INFO - Received callback for node 69c16cde2b2b51e9ad97a142 INFO: 172.19.0.1:60138 - "POST /node/69c16cde2b2b51e9ad97a142 HTTP/1.0" 202 Accepted 2026-03-23 16:41:57,599 - lava_callback - INFO - Starting async job submit for node 69c16cde2b2b51e9ad97a142 2026-03-23 16:41:57,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:57,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cde2b2b51e9ad97a142 HTTP/1.1" 200 None 2026-03-23 16:41:57,667 - lava_callback - DEBUG - Processing node 69c16cde2b2b51e9ad97a142: ltp-dio 2026-03-23 16:41:58,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:58,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:58,237 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69c16cde2b2b51e9ad97a142/log.txt.gz 2026-03-23 16:41:58,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:58,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:58,751 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69c16cde2b2b51e9ad97a142/lava-logs.yaml 2026-03-23 16:41:58,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:41:58,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:41:58,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69c16cde2b2b51e9ad97a142/lava_callback.json.gz 2026-03-23 16:41:58,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:58,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cde2b2b51e9ad97a142 HTTP/1.1" 200 None 2026-03-23 16:41:58,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:59,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:41:59,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:41:59,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cde2b2b51e9ad97a142 HTTP/1.1" 200 None 2026-03-23 16:41:59,052 - lava_callback - INFO - Completed processing callback for node 69c16cde2b2b51e9ad97a142 INFO: 172.19.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58622 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:42:06,925 - lava_callback - INFO - Received callback for node 69beca5ba85a0f2cbb32ce54 INFO: 172.19.0.1:58624 - "POST /node/69beca5ba85a0f2cbb32ce54 HTTP/1.0" 202 Accepted 2026-03-23 16:42:06,933 - lava_callback - INFO - Starting async job submit for node 69beca5ba85a0f2cbb32ce54 2026-03-23 16:42:06,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:06,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beca5ba85a0f2cbb32ce54 HTTP/1.1" 200 None 2026-03-23 16:42:06,952 - lava_callback - DEBUG - Processing node 69beca5ba85a0f2cbb32ce54: baseline-arm64-baylibre 2026-03-23 16:42:06,952 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beca5ba85a0f2cbb32ce54 2026-03-23 16:42:06,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:06,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beca5ba85a0f2cbb32ce54 HTTP/1.1" 200 None 2026-03-23 16:42:06,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:06,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:42:06,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:07,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beca5ba85a0f2cbb32ce54 HTTP/1.1" 200 None 2026-03-23 16:42:07,027 - lava_callback - ERROR - Error processing callback for node 69beca5ba85a0f2cbb32ce54: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55266 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:42:22,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:22,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57108 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:42:45,150 - lava_callback - INFO - Received callback for node 69c16cbc2b2b51e9ad97a0cb INFO: 172.19.0.1:38272 - "POST /node/69c16cbc2b2b51e9ad97a0cb HTTP/1.0" 202 Accepted 2026-03-23 16:42:45,156 - lava_callback - INFO - Starting async job submit for node 69c16cbc2b2b51e9ad97a0cb 2026-03-23 16:42:45,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:45,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbc2b2b51e9ad97a0cb HTTP/1.1" 200 None 2026-03-23 16:42:45,195 - lava_callback - DEBUG - Processing node 69c16cbc2b2b51e9ad97a0cb: baseline-arm-clabbe 2026-03-23 16:42:45,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:42:45,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:42:45,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cbc2b2b51e9ad97a0cb/log.txt.gz 2026-03-23 16:42:45,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:42:45,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:42:45,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cbc2b2b51e9ad97a0cb/lava-logs.yaml 2026-03-23 16:42:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:42:45,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:42:45,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cbc2b2b51e9ad97a0cb/lava_callback.json.gz 2026-03-23 16:42:46,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:46,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbc2b2b51e9ad97a0cb HTTP/1.1" 200 None 2026-03-23 16:42:46,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:46,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:42:46,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:46,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbc2b2b51e9ad97a0cb HTTP/1.1" 200 None 2026-03-23 16:42:46,064 - lava_callback - INFO - Completed processing callback for node 69c16cbc2b2b51e9ad97a0cb INFO: 172.19.0.1:38278 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:42:52,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:42:52,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59230 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:43:27,206 - lava_callback - INFO - Received callback for node 69becaaaa85a0f2cbb32ce5e INFO: 172.19.0.1:59236 - "POST /node/69becaaaa85a0f2cbb32ce5e HTTP/1.0" 202 Accepted 2026-03-23 16:43:27,212 - lava_callback - INFO - Starting async job submit for node 69becaaaa85a0f2cbb32ce5e 2026-03-23 16:43:27,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:43:27,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becaaaa85a0f2cbb32ce5e HTTP/1.1" 200 None 2026-03-23 16:43:27,230 - lava_callback - DEBUG - Processing node 69becaaaa85a0f2cbb32ce5e: baseline-arm64-baylibre 2026-03-23 16:43:27,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becaaaa85a0f2cbb32ce5e 2026-03-23 16:43:27,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:43:27,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becaaaa85a0f2cbb32ce5e HTTP/1.1" 200 None 2026-03-23 16:43:27,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:43:27,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:43:27,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:43:27,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becaaaa85a0f2cbb32ce5e HTTP/1.1" 200 None 2026-03-23 16:43:27,330 - lava_callback - ERROR - Error processing callback for node 69becaaaa85a0f2cbb32ce5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40194 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:44:22,850 - lava_callback - INFO - Received callback for node 69c16ce42b2b51e9ad97a177 INFO: 172.19.0.1:40658 - "POST /node/69c16ce42b2b51e9ad97a177 HTTP/1.0" 202 Accepted 2026-03-23 16:44:22,860 - lava_callback - INFO - Starting async job submit for node 69c16ce42b2b51e9ad97a177 2026-03-23 16:44:22,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:22,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ce42b2b51e9ad97a177 HTTP/1.1" 200 None 2026-03-23 16:44:22,915 - lava_callback - DEBUG - Processing node 69c16ce42b2b51e9ad97a177: ltp-syscalls 2026-03-23 16:44:23,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:44:23,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:44:23,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c16ce42b2b51e9ad97a177/log.txt.gz 2026-03-23 16:44:24,232 - lava_callback - INFO - Received callback for node 69c16cbf2b2b51e9ad97a0d7 2026-03-23 16:44:24,249 - lava_callback - INFO - Starting async job submit for node 69c16cbf2b2b51e9ad97a0d7 INFO: 172.19.0.1:40668 - "POST /node/69c16cbf2b2b51e9ad97a0d7 HTTP/1.0" 202 Accepted 2026-03-23 16:44:24,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:24,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:44:24,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbf2b2b51e9ad97a0d7 HTTP/1.1" 200 None 2026-03-23 16:44:24,291 - lava_callback - DEBUG - Processing node 69c16cbf2b2b51e9ad97a0d7: baseline-arm-clabbe 2026-03-23 16:44:24,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:44:24,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:44:24,619 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c16ce42b2b51e9ad97a177/lava-logs.yaml 2026-03-23 16:44:24,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:44:24,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:44:24,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cbf2b2b51e9ad97a0d7/log.txt.gz 2026-03-23 16:44:24,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:44:24,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69c16ce42b2b51e9ad97a177/lava_callback.json.gz 2026-03-23 16:44:24,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:24,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:44:24,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ce42b2b51e9ad97a177 HTTP/1.1" 200 None 2026-03-23 16:44:24,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:24,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:44:24,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:25,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ce42b2b51e9ad97a177 HTTP/1.1" 200 None 2026-03-23 16:44:25,009 - lava_callback - INFO - Completed processing callback for node 69c16ce42b2b51e9ad97a177 2026-03-23 16:44:25,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:44:25,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cbf2b2b51e9ad97a0d7/lava-logs.yaml 2026-03-23 16:44:25,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:44:25,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:44:25,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cbf2b2b51e9ad97a0d7/lava_callback.json.gz 2026-03-23 16:44:25,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:25,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cbf2b2b51e9ad97a0d7 HTTP/1.1" 200 None 2026-03-23 16:44:25,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:25,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:44:25,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:25,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cbf2b2b51e9ad97a0d7 HTTP/1.1" 200 None 2026-03-23 16:44:25,478 - lava_callback - INFO - Completed processing callback for node 69c16cbf2b2b51e9ad97a0d7 INFO: 172.19.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48654 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:44:47,092 - lava_callback - INFO - Received callback for node 69becafca85a0f2cbb32ce6d INFO: 172.19.0.1:48668 - "POST /node/69becafca85a0f2cbb32ce6d HTTP/1.0" 202 Accepted 2026-03-23 16:44:47,098 - lava_callback - INFO - Starting async job submit for node 69becafca85a0f2cbb32ce6d 2026-03-23 16:44:47,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:47,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becafca85a0f2cbb32ce6d HTTP/1.1" 200 None 2026-03-23 16:44:47,116 - lava_callback - DEBUG - Processing node 69becafca85a0f2cbb32ce6d: baseline-arm64-baylibre 2026-03-23 16:44:47,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becafca85a0f2cbb32ce6d 2026-03-23 16:44:47,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:47,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becafca85a0f2cbb32ce6d HTTP/1.1" 200 None 2026-03-23 16:44:47,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:47,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:44:47,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:47,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becafca85a0f2cbb32ce6d HTTP/1.1" 200 None 2026-03-23 16:44:47,187 - lava_callback - ERROR - Error processing callback for node 69becafca85a0f2cbb32ce6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:44:52,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:44:52,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36328 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:45:16,806 - lava_callback - INFO - Received callback for node 69c16def2b2b51e9ad97a2fa INFO: 172.19.0.1:36332 - "POST /node/69c16def2b2b51e9ad97a2fa HTTP/1.0" 202 Accepted 2026-03-23 16:45:16,813 - lava_callback - INFO - Starting async job submit for node 69c16def2b2b51e9ad97a2fa 2026-03-23 16:45:16,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:16,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16def2b2b51e9ad97a2fa HTTP/1.1" 200 None 2026-03-23 16:45:16,848 - lava_callback - DEBUG - Processing node 69c16def2b2b51e9ad97a2fa: baseline-x86 2026-03-23 16:45:16,928 - lava_callback - INFO - Received callback for node 69c16df12b2b51e9ad97a303 INFO: 172.19.0.1:36340 - "POST /node/69c16df12b2b51e9ad97a303 HTTP/1.0" 202 Accepted 2026-03-23 16:45:16,954 - lava_callback - INFO - Starting async job submit for node 69c16df12b2b51e9ad97a303 2026-03-23 16:45:17,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:17,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:17,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16df12b2b51e9ad97a303 HTTP/1.1" 200 None 2026-03-23 16:45:17,061 - lava_callback - DEBUG - Processing node 69c16df12b2b51e9ad97a303: baseline-x86 2026-03-23 16:45:17,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:17,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:17,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c16def2b2b51e9ad97a2fa/log.txt.gz 2026-03-23 16:45:17,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:17,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:17,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df12b2b51e9ad97a303/log.txt.gz 2026-03-23 16:45:17,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:17,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:17,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c16def2b2b51e9ad97a2fa/lava-logs.yaml 2026-03-23 16:45:17,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:17,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:17,780 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df12b2b51e9ad97a303/lava-logs.yaml 2026-03-23 16:45:17,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:17,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:17,790 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c16def2b2b51e9ad97a2fa/lava_callback.json.gz 2026-03-23 16:45:17,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:17,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16def2b2b51e9ad97a2fa HTTP/1.1" 200 None 2026-03-23 16:45:17,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:17,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167b62b2b51e9ad97796e HTTP/1.1" 200 None 2026-03-23 16:45:17,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:17,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16def2b2b51e9ad97a2fa HTTP/1.1" 200 None 2026-03-23 16:45:17,891 - lava_callback - INFO - Completed processing callback for node 69c16def2b2b51e9ad97a2fa 2026-03-23 16:45:17,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:17,970 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df12b2b51e9ad97a303/lava_callback.json.gz 2026-03-23 16:45:17,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:18,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16df12b2b51e9ad97a303 HTTP/1.1" 200 None 2026-03-23 16:45:18,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:18,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167b62b2b51e9ad97796e HTTP/1.1" 200 None 2026-03-23 16:45:18,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:18,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16df12b2b51e9ad97a303 HTTP/1.1" 200 None 2026-03-23 16:45:18,068 - lava_callback - INFO - Completed processing callback for node 69c16df12b2b51e9ad97a303 2026-03-23 16:45:22,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:22,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34386 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:45:47,836 - lava_callback - INFO - Received callback for node 69c16def2b2b51e9ad97a2fd INFO: 172.19.0.1:34398 - "POST /node/69c16def2b2b51e9ad97a2fd HTTP/1.0" 202 Accepted 2026-03-23 16:45:47,842 - lava_callback - INFO - Starting async job submit for node 69c16def2b2b51e9ad97a2fd 2026-03-23 16:45:47,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:47,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16def2b2b51e9ad97a2fd HTTP/1.1" 200 None 2026-03-23 16:45:47,877 - lava_callback - DEBUG - Processing node 69c16def2b2b51e9ad97a2fd: baseline-x86 2026-03-23 16:45:48,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:48,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:48,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c16def2b2b51e9ad97a2fd/log.txt.gz 2026-03-23 16:45:48,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:48,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:48,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c16def2b2b51e9ad97a2fd/lava-logs.yaml 2026-03-23 16:45:48,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:45:48,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:45:48,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c16def2b2b51e9ad97a2fd/lava_callback.json.gz 2026-03-23 16:45:48,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:48,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16def2b2b51e9ad97a2fd HTTP/1.1" 200 None 2026-03-23 16:45:48,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:48,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167b62b2b51e9ad97796e HTTP/1.1" 200 None 2026-03-23 16:45:48,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:48,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16def2b2b51e9ad97a2fd HTTP/1.1" 200 None 2026-03-23 16:45:48,983 - lava_callback - INFO - Completed processing callback for node 69c16def2b2b51e9ad97a2fd 2026-03-23 16:45:52,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:45:52,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38660 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:46:07,226 - lava_callback - INFO - Received callback for node 69c16cc02b2b51e9ad97a0da INFO: 172.19.0.1:38672 - "POST /node/69c16cc02b2b51e9ad97a0da HTTP/1.0" 202 Accepted 2026-03-23 16:46:07,231 - lava_callback - INFO - Starting async job submit for node 69c16cc02b2b51e9ad97a0da 2026-03-23 16:46:07,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:07,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc02b2b51e9ad97a0da HTTP/1.1" 200 None 2026-03-23 16:46:07,269 - lava_callback - DEBUG - Processing node 69c16cc02b2b51e9ad97a0da: baseline-arm-clabbe 2026-03-23 16:46:07,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:46:07,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:46:07,651 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cc02b2b51e9ad97a0da/log.txt.gz 2026-03-23 16:46:07,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:46:07,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:46:07,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cc02b2b51e9ad97a0da/lava-logs.yaml 2026-03-23 16:46:07,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:46:08,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:46:08,097 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69c16cc02b2b51e9ad97a0da/lava_callback.json.gz 2026-03-23 16:46:08,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:08,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc02b2b51e9ad97a0da HTTP/1.1" 200 None 2026-03-23 16:46:08,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:08,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:46:08,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:08,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cc02b2b51e9ad97a0da HTTP/1.1" 200 None 2026-03-23 16:46:08,200 - lava_callback - INFO - Completed processing callback for node 69c16cc02b2b51e9ad97a0da INFO: 172.19.0.1:58918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58934 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:46:18,587 - lava_callback - INFO - Received callback for node 69c16df02b2b51e9ad97a300 INFO: 172.19.0.1:58938 - "POST /node/69c16df02b2b51e9ad97a300 HTTP/1.0" 202 Accepted 2026-03-23 16:46:18,594 - lava_callback - INFO - Starting async job submit for node 69c16df02b2b51e9ad97a300 2026-03-23 16:46:18,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:18,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16df02b2b51e9ad97a300 HTTP/1.1" 200 None 2026-03-23 16:46:18,632 - lava_callback - DEBUG - Processing node 69c16df02b2b51e9ad97a300: baseline-x86 2026-03-23 16:46:18,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:46:19,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:46:19,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df02b2b51e9ad97a300/log.txt.gz 2026-03-23 16:46:19,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:46:19,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:46:19,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df02b2b51e9ad97a300/lava-logs.yaml 2026-03-23 16:46:19,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:46:19,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:46:19,605 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df02b2b51e9ad97a300/lava_callback.json.gz 2026-03-23 16:46:19,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:19,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16df02b2b51e9ad97a300 HTTP/1.1" 200 None 2026-03-23 16:46:19,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:19,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167b62b2b51e9ad97796e HTTP/1.1" 200 None 2026-03-23 16:46:19,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:19,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16df02b2b51e9ad97a300 HTTP/1.1" 200 None 2026-03-23 16:46:19,691 - lava_callback - INFO - Completed processing callback for node 69c16df02b2b51e9ad97a300 2026-03-23 16:46:22,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:22,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44722 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:46:27,270 - lava_callback - INFO - Received callback for node 69becb4ea85a0f2cbb32ce79 INFO: 172.19.0.1:44726 - "POST /node/69becb4ea85a0f2cbb32ce79 HTTP/1.0" 202 Accepted 2026-03-23 16:46:27,279 - lava_callback - INFO - Starting async job submit for node 69becb4ea85a0f2cbb32ce79 2026-03-23 16:46:27,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:27,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becb4ea85a0f2cbb32ce79 HTTP/1.1" 200 None 2026-03-23 16:46:27,312 - lava_callback - DEBUG - Processing node 69becb4ea85a0f2cbb32ce79: baseline-arm64-baylibre 2026-03-23 16:46:27,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becb4ea85a0f2cbb32ce79 2026-03-23 16:46:27,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:27,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becb4ea85a0f2cbb32ce79 HTTP/1.1" 200 None 2026-03-23 16:46:27,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:27,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:46:27,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:46:27,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becb4ea85a0f2cbb32ce79 HTTP/1.1" 200 None 2026-03-23 16:46:27,418 - lava_callback - ERROR - Error processing callback for node 69becb4ea85a0f2cbb32ce79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57908 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:47:27,211 - lava_callback - INFO - Received callback for node 69becb9da85a0f2cbb32cec9 INFO: 172.19.0.1:57916 - "POST /node/69becb9da85a0f2cbb32cec9 HTTP/1.0" 202 Accepted 2026-03-23 16:47:27,218 - lava_callback - INFO - Starting async job submit for node 69becb9da85a0f2cbb32cec9 2026-03-23 16:47:27,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:27,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becb9da85a0f2cbb32cec9 HTTP/1.1" 200 None 2026-03-23 16:47:27,237 - lava_callback - DEBUG - Processing node 69becb9da85a0f2cbb32cec9: baseline-arm64-baylibre 2026-03-23 16:47:27,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becb9da85a0f2cbb32cec9 2026-03-23 16:47:27,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:27,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becb9da85a0f2cbb32cec9 HTTP/1.1" 200 None 2026-03-23 16:47:27,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:27,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:47:27,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:27,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becb9da85a0f2cbb32cec9 HTTP/1.1" 200 None 2026-03-23 16:47:27,321 - lava_callback - ERROR - Error processing callback for node 69becb9da85a0f2cbb32cec9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:47:31,426 - lava_callback - INFO - Received callback for node 69c16e942b2b51e9ad97a35b INFO: 172.19.0.1:55342 - "POST /node/69c16e942b2b51e9ad97a35b HTTP/1.0" 202 Accepted 2026-03-23 16:47:31,432 - lava_callback - INFO - Starting async job submit for node 69c16e942b2b51e9ad97a35b 2026-03-23 16:47:31,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:31,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16e942b2b51e9ad97a35b HTTP/1.1" 200 None 2026-03-23 16:47:31,452 - lava_callback - DEBUG - Processing node 69c16e942b2b51e9ad97a35b: baseline-arm 2026-03-23 16:47:31,457 - lava_callback - WARNING - Failed to upload log 2026-03-23 16:47:31,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:47:31,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:47:31,596 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16e942b2b51e9ad97a35b/lava-logs.yaml 2026-03-23 16:47:31,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:47:31,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:47:31,731 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16e942b2b51e9ad97a35b/lava_callback.json.gz 2026-03-23 16:47:31,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:31,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16e942b2b51e9ad97a35b HTTP/1.1" 200 None 2026-03-23 16:47:31,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:31,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:47:31,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:31,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16e942b2b51e9ad97a35b HTTP/1.1" 200 None 2026-03-23 16:47:31,796 - lava_callback - INFO - Completed processing callback for node 69c16e942b2b51e9ad97a35b INFO: 172.19.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55526 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:47:52,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:47:52,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50476 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:48:07,256 - lava_callback - INFO - Received callback for node 69becbbda85a0f2cbb32cf3b INFO: 172.19.0.1:50482 - "POST /node/69becbbda85a0f2cbb32cf3b HTTP/1.0" 202 Accepted 2026-03-23 16:48:07,262 - lava_callback - INFO - Starting async job submit for node 69becbbda85a0f2cbb32cf3b 2026-03-23 16:48:07,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbbda85a0f2cbb32cf3b HTTP/1.1" 200 None 2026-03-23 16:48:07,279 - lava_callback - DEBUG - Processing node 69becbbda85a0f2cbb32cf3b: baseline-arm64-baylibre 2026-03-23 16:48:07,279 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbbda85a0f2cbb32cf3b 2026-03-23 16:48:07,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbbda85a0f2cbb32cf3b HTTP/1.1" 200 None 2026-03-23 16:48:07,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:07,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbbda85a0f2cbb32cf3b HTTP/1.1" 200 None 2026-03-23 16:48:07,341 - lava_callback - ERROR - Error processing callback for node 69becbbda85a0f2cbb32cf3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:07,898 - lava_callback - INFO - Received callback for node 69becbbea85a0f2cbb32cf3e INFO: 172.19.0.1:50498 - "POST /node/69becbbea85a0f2cbb32cf3e HTTP/1.0" 202 Accepted 2026-03-23 16:48:07,904 - lava_callback - INFO - Starting async job submit for node 69becbbea85a0f2cbb32cf3e 2026-03-23 16:48:07,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbbea85a0f2cbb32cf3e HTTP/1.1" 200 None 2026-03-23 16:48:07,927 - lava_callback - DEBUG - Processing node 69becbbea85a0f2cbb32cf3e: baseline-arm64-baylibre 2026-03-23 16:48:07,927 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbbea85a0f2cbb32cf3e 2026-03-23 16:48:07,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbbea85a0f2cbb32cf3e HTTP/1.1" 200 None 2026-03-23 16:48:07,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:07,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:07,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbbea85a0f2cbb32cf3e HTTP/1.1" 200 None 2026-03-23 16:48:07,989 - lava_callback - ERROR - Error processing callback for node 69becbbea85a0f2cbb32cf3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:08,567 - lava_callback - INFO - Received callback for node 69becbc3a85a0f2cbb32cf4b INFO: 172.19.0.1:50502 - "POST /node/69becbc3a85a0f2cbb32cf4b HTTP/1.0" 202 Accepted 2026-03-23 16:48:08,577 - lava_callback - INFO - Starting async job submit for node 69becbc3a85a0f2cbb32cf4b 2026-03-23 16:48:08,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:08,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbc3a85a0f2cbb32cf4b HTTP/1.1" 200 None 2026-03-23 16:48:08,594 - lava_callback - DEBUG - Processing node 69becbc3a85a0f2cbb32cf4b: baseline-arm64-baylibre 2026-03-23 16:48:08,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbc3a85a0f2cbb32cf4b 2026-03-23 16:48:08,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:08,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbc3a85a0f2cbb32cf4b HTTP/1.1" 200 None 2026-03-23 16:48:08,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:08,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:08,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:08,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbc3a85a0f2cbb32cf4b HTTP/1.1" 200 None 2026-03-23 16:48:08,657 - lava_callback - ERROR - Error processing callback for node 69becbc3a85a0f2cbb32cf4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:09,241 - lava_callback - INFO - Received callback for node 69becbbba85a0f2cbb32cf38 INFO: 172.19.0.1:50506 - "POST /node/69becbbba85a0f2cbb32cf38 HTTP/1.0" 202 Accepted 2026-03-23 16:48:09,246 - lava_callback - INFO - Starting async job submit for node 69becbbba85a0f2cbb32cf38 2026-03-23 16:48:09,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbbba85a0f2cbb32cf38 HTTP/1.1" 200 None 2026-03-23 16:48:09,264 - lava_callback - DEBUG - Processing node 69becbbba85a0f2cbb32cf38: baseline-arm64-baylibre 2026-03-23 16:48:09,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbbba85a0f2cbb32cf38 2026-03-23 16:48:09,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbbba85a0f2cbb32cf38 HTTP/1.1" 200 None 2026-03-23 16:48:09,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:09,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbbba85a0f2cbb32cf38 HTTP/1.1" 200 None 2026-03-23 16:48:09,329 - lava_callback - ERROR - Error processing callback for node 69becbbba85a0f2cbb32cf38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:09,883 - lava_callback - INFO - Received callback for node 69becbc0a85a0f2cbb32cf45 INFO: 172.19.0.1:52532 - "POST /node/69becbc0a85a0f2cbb32cf45 HTTP/1.0" 202 Accepted 2026-03-23 16:48:09,890 - lava_callback - INFO - Starting async job submit for node 69becbc0a85a0f2cbb32cf45 2026-03-23 16:48:09,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbc0a85a0f2cbb32cf45 HTTP/1.1" 200 None 2026-03-23 16:48:09,923 - lava_callback - DEBUG - Processing node 69becbc0a85a0f2cbb32cf45: baseline-arm64-baylibre 2026-03-23 16:48:09,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbc0a85a0f2cbb32cf45 2026-03-23 16:48:09,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbc0a85a0f2cbb32cf45 HTTP/1.1" 200 None 2026-03-23 16:48:09,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:09,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:09,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbc0a85a0f2cbb32cf45 HTTP/1.1" 200 None 2026-03-23 16:48:09,988 - lava_callback - ERROR - Error processing callback for node 69becbc0a85a0f2cbb32cf45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:10,546 - lava_callback - INFO - Received callback for node 69becbc2a85a0f2cbb32cf48 INFO: 172.19.0.1:52540 - "POST /node/69becbc2a85a0f2cbb32cf48 HTTP/1.0" 202 Accepted 2026-03-23 16:48:10,552 - lava_callback - INFO - Starting async job submit for node 69becbc2a85a0f2cbb32cf48 2026-03-23 16:48:10,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:10,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbc2a85a0f2cbb32cf48 HTTP/1.1" 200 None 2026-03-23 16:48:10,575 - lava_callback - DEBUG - Processing node 69becbc2a85a0f2cbb32cf48: baseline-arm64-baylibre 2026-03-23 16:48:10,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbc2a85a0f2cbb32cf48 2026-03-23 16:48:10,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:10,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbc2a85a0f2cbb32cf48 HTTP/1.1" 200 None 2026-03-23 16:48:10,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:10,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:10,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:10,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbc2a85a0f2cbb32cf48 HTTP/1.1" 200 None 2026-03-23 16:48:10,636 - lava_callback - ERROR - Error processing callback for node 69becbc2a85a0f2cbb32cf48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54094 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:48:27,609 - lava_callback - INFO - Received callback for node 69c16cc52b2b51e9ad97a0ec INFO: 172.19.0.1:54102 - "POST /node/69c16cc52b2b51e9ad97a0ec HTTP/1.0" 202 Accepted 2026-03-23 16:48:27,615 - lava_callback - INFO - Starting async job submit for node 69c16cc52b2b51e9ad97a0ec 2026-03-23 16:48:27,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:27,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc52b2b51e9ad97a0ec HTTP/1.1" 200 None 2026-03-23 16:48:27,658 - lava_callback - DEBUG - Processing node 69c16cc52b2b51e9ad97a0ec: baseline-arm-pengutronix 2026-03-23 16:48:27,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:48:28,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:48:28,034 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc52b2b51e9ad97a0ec/log.txt.gz 2026-03-23 16:48:28,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:48:28,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:48:28,358 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc52b2b51e9ad97a0ec/lava-logs.yaml 2026-03-23 16:48:28,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:48:28,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:48:28,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc52b2b51e9ad97a0ec/lava_callback.json.gz 2026-03-23 16:48:28,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:28,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc52b2b51e9ad97a0ec HTTP/1.1" 200 None 2026-03-23 16:48:28,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:28,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:48:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:28,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cc52b2b51e9ad97a0ec HTTP/1.1" 200 None 2026-03-23 16:48:28,727 - lava_callback - INFO - Completed processing callback for node 69c16cc52b2b51e9ad97a0ec 2026-03-23 16:48:34,940 - lava_callback - INFO - Received callback for node 69becbd3a85a0f2cbb32cf92 INFO: 172.19.0.1:40780 - "POST /node/69becbd3a85a0f2cbb32cf92 HTTP/1.0" 202 Accepted 2026-03-23 16:48:34,946 - lava_callback - INFO - Starting async job submit for node 69becbd3a85a0f2cbb32cf92 2026-03-23 16:48:34,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:34,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd3a85a0f2cbb32cf92 HTTP/1.1" 200 None 2026-03-23 16:48:34,963 - lava_callback - DEBUG - Processing node 69becbd3a85a0f2cbb32cf92: baseline-arm64-clabbe 2026-03-23 16:48:34,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbd3a85a0f2cbb32cf92 2026-03-23 16:48:34,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:34,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd3a85a0f2cbb32cf92 HTTP/1.1" 200 None 2026-03-23 16:48:34,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:34,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:34,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:35,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbd3a85a0f2cbb32cf92 HTTP/1.1" 200 None 2026-03-23 16:48:35,019 - lava_callback - ERROR - Error processing callback for node 69becbd3a85a0f2cbb32cf92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:35,636 - lava_callback - INFO - Received callback for node 69becbd6a85a0f2cbb32cf95 INFO: 172.19.0.1:40786 - "POST /node/69becbd6a85a0f2cbb32cf95 HTTP/1.0" 202 Accepted 2026-03-23 16:48:35,643 - lava_callback - INFO - Starting async job submit for node 69becbd6a85a0f2cbb32cf95 2026-03-23 16:48:35,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:35,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd6a85a0f2cbb32cf95 HTTP/1.1" 200 None 2026-03-23 16:48:35,662 - lava_callback - DEBUG - Processing node 69becbd6a85a0f2cbb32cf95: baseline-arm64-clabbe 2026-03-23 16:48:35,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbd6a85a0f2cbb32cf95 2026-03-23 16:48:35,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:35,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd6a85a0f2cbb32cf95 HTTP/1.1" 200 None 2026-03-23 16:48:35,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:35,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:35,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:35,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbd6a85a0f2cbb32cf95 HTTP/1.1" 200 None 2026-03-23 16:48:35,734 - lava_callback - ERROR - Error processing callback for node 69becbd6a85a0f2cbb32cf95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:36,336 - lava_callback - INFO - Received callback for node 69becbd6a85a0f2cbb32cf98 INFO: 172.19.0.1:40800 - "POST /node/69becbd6a85a0f2cbb32cf98 HTTP/1.0" 202 Accepted 2026-03-23 16:48:36,342 - lava_callback - INFO - Starting async job submit for node 69becbd6a85a0f2cbb32cf98 2026-03-23 16:48:36,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:36,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd6a85a0f2cbb32cf98 HTTP/1.1" 200 None 2026-03-23 16:48:36,379 - lava_callback - DEBUG - Processing node 69becbd6a85a0f2cbb32cf98: baseline-arm64-clabbe 2026-03-23 16:48:36,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbd6a85a0f2cbb32cf98 2026-03-23 16:48:36,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:36,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd6a85a0f2cbb32cf98 HTTP/1.1" 200 None 2026-03-23 16:48:36,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:36,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:36,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:36,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbd6a85a0f2cbb32cf98 HTTP/1.1" 200 None 2026-03-23 16:48:36,436 - lava_callback - ERROR - Error processing callback for node 69becbd6a85a0f2cbb32cf98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40814 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:48:37,033 - lava_callback - INFO - Received callback for node 69becbd7a85a0f2cbb32cf9b INFO: 172.19.0.1:40830 - "POST /node/69becbd7a85a0f2cbb32cf9b HTTP/1.0" 202 Accepted 2026-03-23 16:48:37,038 - lava_callback - INFO - Starting async job submit for node 69becbd7a85a0f2cbb32cf9b 2026-03-23 16:48:37,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd7a85a0f2cbb32cf9b HTTP/1.1" 200 None 2026-03-23 16:48:37,055 - lava_callback - DEBUG - Processing node 69becbd7a85a0f2cbb32cf9b: baseline-arm64-clabbe 2026-03-23 16:48:37,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbd7a85a0f2cbb32cf9b 2026-03-23 16:48:37,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd7a85a0f2cbb32cf9b HTTP/1.1" 200 None 2026-03-23 16:48:37,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:37,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbd7a85a0f2cbb32cf9b HTTP/1.1" 200 None 2026-03-23 16:48:37,128 - lava_callback - ERROR - Error processing callback for node 69becbd7a85a0f2cbb32cf9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:37,709 - lava_callback - INFO - Received callback for node 69becbd9a85a0f2cbb32cfa1 INFO: 172.19.0.1:40832 - "POST /node/69becbd9a85a0f2cbb32cfa1 HTTP/1.0" 202 Accepted 2026-03-23 16:48:37,715 - lava_callback - INFO - Starting async job submit for node 69becbd9a85a0f2cbb32cfa1 2026-03-23 16:48:37,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd9a85a0f2cbb32cfa1 HTTP/1.1" 200 None 2026-03-23 16:48:37,736 - lava_callback - DEBUG - Processing node 69becbd9a85a0f2cbb32cfa1: baseline-arm64-clabbe 2026-03-23 16:48:37,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbd9a85a0f2cbb32cfa1 2026-03-23 16:48:37,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbd9a85a0f2cbb32cfa1 HTTP/1.1" 200 None 2026-03-23 16:48:37,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:37,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:37,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbd9a85a0f2cbb32cfa1 HTTP/1.1" 200 None 2026-03-23 16:48:37,819 - lava_callback - ERROR - Error processing callback for node 69becbd9a85a0f2cbb32cfa1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:48:38,410 - lava_callback - INFO - Received callback for node 69becbdaa85a0f2cbb32cfa6 INFO: 172.19.0.1:40846 - "POST /node/69becbdaa85a0f2cbb32cfa6 HTTP/1.0" 202 Accepted 2026-03-23 16:48:38,418 - lava_callback - INFO - Starting async job submit for node 69becbdaa85a0f2cbb32cfa6 2026-03-23 16:48:38,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:38,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbdaa85a0f2cbb32cfa6 HTTP/1.1" 200 None 2026-03-23 16:48:38,435 - lava_callback - DEBUG - Processing node 69becbdaa85a0f2cbb32cfa6: baseline-arm64-clabbe 2026-03-23 16:48:38,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becbdaa85a0f2cbb32cfa6 2026-03-23 16:48:38,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:38,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becbdaa85a0f2cbb32cfa6 HTTP/1.1" 200 None 2026-03-23 16:48:38,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:38,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 16:48:38,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:38,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becbdaa85a0f2cbb32cfa6 HTTP/1.1" 200 None 2026-03-23 16:48:38,503 - lava_callback - ERROR - Error processing callback for node 69becbdaa85a0f2cbb32cfa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39196 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:48:52,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:48:52,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41666 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:49:47,392 - lava_callback - INFO - Received callback for node 69becc20a85a0f2cbb32d064 INFO: 172.19.0.1:41680 - "POST /node/69becc20a85a0f2cbb32d064 HTTP/1.0" 202 Accepted 2026-03-23 16:49:47,398 - lava_callback - INFO - Starting async job submit for node 69becc20a85a0f2cbb32d064 2026-03-23 16:49:47,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:47,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc20a85a0f2cbb32d064 HTTP/1.1" 200 None 2026-03-23 16:49:47,415 - lava_callback - DEBUG - Processing node 69becc20a85a0f2cbb32d064: baseline-arm-baylibre 2026-03-23 16:49:47,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc20a85a0f2cbb32d064 2026-03-23 16:49:47,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:47,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc20a85a0f2cbb32d064 HTTP/1.1" 200 None 2026-03-23 16:49:47,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:47,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:49:47,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:47,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc20a85a0f2cbb32d064 HTTP/1.1" 200 None 2026-03-23 16:49:47,475 - lava_callback - ERROR - Error processing callback for node 69becc20a85a0f2cbb32d064: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:49:48,036 - lava_callback - INFO - Received callback for node 69becc22a85a0f2cbb32d06b INFO: 172.19.0.1:41684 - "POST /node/69becc22a85a0f2cbb32d06b HTTP/1.0" 202 Accepted 2026-03-23 16:49:48,042 - lava_callback - INFO - Starting async job submit for node 69becc22a85a0f2cbb32d06b 2026-03-23 16:49:48,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc22a85a0f2cbb32d06b HTTP/1.1" 200 None 2026-03-23 16:49:48,071 - lava_callback - DEBUG - Processing node 69becc22a85a0f2cbb32d06b: baseline-arm-baylibre 2026-03-23 16:49:48,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc22a85a0f2cbb32d06b 2026-03-23 16:49:48,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc22a85a0f2cbb32d06b HTTP/1.1" 200 None 2026-03-23 16:49:48,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:49:48,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc22a85a0f2cbb32d06b HTTP/1.1" 200 None 2026-03-23 16:49:48,131 - lava_callback - ERROR - Error processing callback for node 69becc22a85a0f2cbb32d06b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:49:48,721 - lava_callback - INFO - Received callback for node 69becc24a85a0f2cbb32d098 INFO: 172.19.0.1:41700 - "POST /node/69becc24a85a0f2cbb32d098 HTTP/1.0" 202 Accepted 2026-03-23 16:49:48,727 - lava_callback - INFO - Starting async job submit for node 69becc24a85a0f2cbb32d098 2026-03-23 16:49:48,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc24a85a0f2cbb32d098 HTTP/1.1" 200 None 2026-03-23 16:49:48,742 - lava_callback - DEBUG - Processing node 69becc24a85a0f2cbb32d098: baseline-arm-baylibre 2026-03-23 16:49:48,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc24a85a0f2cbb32d098 2026-03-23 16:49:48,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc24a85a0f2cbb32d098 HTTP/1.1" 200 None 2026-03-23 16:49:48,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:49:48,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:48,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc24a85a0f2cbb32d098 HTTP/1.1" 200 None 2026-03-23 16:49:48,802 - lava_callback - ERROR - Error processing callback for node 69becc24a85a0f2cbb32d098: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:49:49,375 - lava_callback - INFO - Received callback for node 69becc27a85a0f2cbb32d09e INFO: 172.19.0.1:41710 - "POST /node/69becc27a85a0f2cbb32d09e HTTP/1.0" 202 Accepted 2026-03-23 16:49:49,380 - lava_callback - INFO - Starting async job submit for node 69becc27a85a0f2cbb32d09e 2026-03-23 16:49:49,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:49,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc27a85a0f2cbb32d09e HTTP/1.1" 200 None 2026-03-23 16:49:49,397 - lava_callback - DEBUG - Processing node 69becc27a85a0f2cbb32d09e: baseline-arm-baylibre 2026-03-23 16:49:49,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc27a85a0f2cbb32d09e 2026-03-23 16:49:49,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:49,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc27a85a0f2cbb32d09e HTTP/1.1" 200 None 2026-03-23 16:49:49,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:49,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:49:49,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:49:49,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc27a85a0f2cbb32d09e HTTP/1.1" 200 None 2026-03-23 16:49:49,452 - lava_callback - ERROR - Error processing callback for node 69becc27a85a0f2cbb32d09e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55700 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:50:07,351 - lava_callback - INFO - Received callback for node 69becc2ca85a0f2cbb32d0b5 INFO: 172.19.0.1:55710 - "POST /node/69becc2ca85a0f2cbb32d0b5 HTTP/1.0" 202 Accepted 2026-03-23 16:50:07,356 - lava_callback - INFO - Starting async job submit for node 69becc2ca85a0f2cbb32d0b5 2026-03-23 16:50:07,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:07,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc2ca85a0f2cbb32d0b5 HTTP/1.1" 200 None 2026-03-23 16:50:07,373 - lava_callback - DEBUG - Processing node 69becc2ca85a0f2cbb32d0b5: baseline-arm-baylibre 2026-03-23 16:50:07,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc2ca85a0f2cbb32d0b5 2026-03-23 16:50:07,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:07,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc2ca85a0f2cbb32d0b5 HTTP/1.1" 200 None 2026-03-23 16:50:07,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:07,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:50:07,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:07,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc2ca85a0f2cbb32d0b5 HTTP/1.1" 200 None 2026-03-23 16:50:07,438 - lava_callback - ERROR - Error processing callback for node 69becc2ca85a0f2cbb32d0b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:50:08,022 - lava_callback - INFO - Received callback for node 69becc2ea85a0f2cbb32d0bf INFO: 172.19.0.1:55716 - "POST /node/69becc2ea85a0f2cbb32d0bf HTTP/1.0" 202 Accepted 2026-03-23 16:50:08,028 - lava_callback - INFO - Starting async job submit for node 69becc2ea85a0f2cbb32d0bf 2026-03-23 16:50:08,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:08,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc2ea85a0f2cbb32d0bf HTTP/1.1" 200 None 2026-03-23 16:50:08,044 - lava_callback - DEBUG - Processing node 69becc2ea85a0f2cbb32d0bf: baseline-arm-baylibre 2026-03-23 16:50:08,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc2ea85a0f2cbb32d0bf 2026-03-23 16:50:08,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:08,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc2ea85a0f2cbb32d0bf HTTP/1.1" 200 None 2026-03-23 16:50:08,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:08,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:50:08,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:08,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc2ea85a0f2cbb32d0bf HTTP/1.1" 200 None 2026-03-23 16:50:08,111 - lava_callback - ERROR - Error processing callback for node 69becc2ea85a0f2cbb32d0bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:50:14,962 - lava_callback - INFO - Received callback for node 69becc3aa85a0f2cbb32d0e2 INFO: 172.19.0.1:47350 - "POST /node/69becc3aa85a0f2cbb32d0e2 HTTP/1.0" 202 Accepted 2026-03-23 16:50:14,968 - lava_callback - INFO - Starting async job submit for node 69becc3aa85a0f2cbb32d0e2 2026-03-23 16:50:14,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:14,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc3aa85a0f2cbb32d0e2 HTTP/1.1" 200 None 2026-03-23 16:50:14,984 - lava_callback - DEBUG - Processing node 69becc3aa85a0f2cbb32d0e2: baseline-arm-clabbe 2026-03-23 16:50:14,984 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc3aa85a0f2cbb32d0e2 2026-03-23 16:50:14,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:14,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc3aa85a0f2cbb32d0e2 HTTP/1.1" 200 None 2026-03-23 16:50:15,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:15,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:50:15,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:15,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc3aa85a0f2cbb32d0e2 HTTP/1.1" 200 None 2026-03-23 16:50:15,051 - lava_callback - ERROR - Error processing callback for node 69becc3aa85a0f2cbb32d0e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47356 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 16:50:15,639 - lava_callback - INFO - Received callback for node 69becc41a85a0f2cbb32d0f4 INFO: 172.19.0.1:47362 - "POST /node/69becc41a85a0f2cbb32d0f4 HTTP/1.0" 202 Accepted 2026-03-23 16:50:15,645 - lava_callback - INFO - Starting async job submit for node 69becc41a85a0f2cbb32d0f4 2026-03-23 16:50:15,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:15,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc41a85a0f2cbb32d0f4 HTTP/1.1" 200 None 2026-03-23 16:50:15,666 - lava_callback - DEBUG - Processing node 69becc41a85a0f2cbb32d0f4: baseline-arm-clabbe 2026-03-23 16:50:15,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc41a85a0f2cbb32d0f4 2026-03-23 16:50:15,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:15,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc41a85a0f2cbb32d0f4 HTTP/1.1" 200 None 2026-03-23 16:50:15,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:15,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:50:15,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:15,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc41a85a0f2cbb32d0f4 HTTP/1.1" 200 None 2026-03-23 16:50:15,734 - lava_callback - ERROR - Error processing callback for node 69becc41a85a0f2cbb32d0f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-23 16:50:16,320 - lava_callback - INFO - Received callback for node 69becc42a85a0f2cbb32d127 INFO: 172.19.0.1:47366 - "POST /node/69becc42a85a0f2cbb32d127 HTTP/1.0" 202 Accepted 2026-03-23 16:50:16,325 - lava_callback - INFO - Starting async job submit for node 69becc42a85a0f2cbb32d127 2026-03-23 16:50:16,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:16,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc42a85a0f2cbb32d127 HTTP/1.1" 200 None 2026-03-23 16:50:16,347 - lava_callback - DEBUG - Processing node 69becc42a85a0f2cbb32d127: baseline-arm-clabbe 2026-03-23 16:50:16,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc42a85a0f2cbb32d127 2026-03-23 16:50:16,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:16,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc42a85a0f2cbb32d127 HTTP/1.1" 200 None 2026-03-23 16:50:16,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:16,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:50:16,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:16,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc42a85a0f2cbb32d127 HTTP/1.1" 200 None 2026-03-23 16:50:16,411 - lava_callback - ERROR - Error processing callback for node 69becc42a85a0f2cbb32d127: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47378 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:50:17,027 - lava_callback - INFO - Received callback for node 69becc43a85a0f2cbb32d12a INFO: 172.19.0.1:47380 - "POST /node/69becc43a85a0f2cbb32d12a HTTP/1.0" 202 Accepted 2026-03-23 16:50:17,033 - lava_callback - INFO - Starting async job submit for node 69becc43a85a0f2cbb32d12a 2026-03-23 16:50:17,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:17,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc43a85a0f2cbb32d12a HTTP/1.1" 200 None 2026-03-23 16:50:17,055 - lava_callback - DEBUG - Processing node 69becc43a85a0f2cbb32d12a: baseline-arm-clabbe 2026-03-23 16:50:17,056 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc43a85a0f2cbb32d12a 2026-03-23 16:50:17,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:17,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc43a85a0f2cbb32d12a HTTP/1.1" 200 None 2026-03-23 16:50:17,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:17,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:50:17,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:17,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc43a85a0f2cbb32d12a HTTP/1.1" 200 None 2026-03-23 16:50:17,114 - lava_callback - ERROR - Error processing callback for node 69becc43a85a0f2cbb32d12a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39788 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:50:32,656 - lava_callback - INFO - Received callback for node 69c16a432b2b51e9ad977992 INFO: 172.19.0.1:42494 - "POST /node/69c16a432b2b51e9ad977992 HTTP/1.0" 202 Accepted 2026-03-23 16:50:32,663 - lava_callback - INFO - Starting async job submit for node 69c16a432b2b51e9ad977992 2026-03-23 16:50:32,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:32,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16a432b2b51e9ad977992 HTTP/1.1" 200 None 2026-03-23 16:50:32,736 - lava_callback - DEBUG - Processing node 69c16a432b2b51e9ad977992: ltp-smoke 2026-03-23 16:50:33,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:50:33,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:50:33,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c16a432b2b51e9ad977992/log.txt.gz 2026-03-23 16:50:33,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:50:33,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:50:33,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c16a432b2b51e9ad977992/lava-logs.yaml 2026-03-23 16:50:33,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:50:34,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:50:34,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c16a432b2b51e9ad977992/lava_callback.json.gz 2026-03-23 16:50:34,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:34,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16a432b2b51e9ad977992 HTTP/1.1" 200 None 2026-03-23 16:50:34,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:34,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1678e2b2b51e9ad97794c HTTP/1.1" 200 None 2026-03-23 16:50:34,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:34,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16a432b2b51e9ad977992 HTTP/1.1" 200 None 2026-03-23 16:50:34,395 - lava_callback - INFO - Completed processing callback for node 69c16a432b2b51e9ad977992 2026-03-23 16:50:35,022 - lava_callback - INFO - Received callback for node 69becc47a85a0f2cbb32d133 INFO: 172.19.0.1:42508 - "POST /node/69becc47a85a0f2cbb32d133 HTTP/1.0" 202 Accepted 2026-03-23 16:50:35,027 - lava_callback - INFO - Starting async job submit for node 69becc47a85a0f2cbb32d133 2026-03-23 16:50:35,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:35,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc47a85a0f2cbb32d133 HTTP/1.1" 200 None 2026-03-23 16:50:35,044 - lava_callback - DEBUG - Processing node 69becc47a85a0f2cbb32d133: baseline-arm-clabbe 2026-03-23 16:50:35,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becc47a85a0f2cbb32d133 2026-03-23 16:50:35,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:35,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becc47a85a0f2cbb32d133 HTTP/1.1" 200 None 2026-03-23 16:50:35,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:35,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 16:50:35,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:35,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becc47a85a0f2cbb32d133 HTTP/1.1" 200 None 2026-03-23 16:50:35,123 - lava_callback - ERROR - Error processing callback for node 69becc47a85a0f2cbb32d133: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53336 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:50:52,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:50:52,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51890 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:52:35,127 - lava_callback - INFO - Received callback for node 69becccea85a0f2cbb32d23b INFO: 172.19.0.1:51614 - "POST /node/69becccea85a0f2cbb32d23b HTTP/1.0" 202 Accepted 2026-03-23 16:52:35,133 - lava_callback - INFO - Starting async job submit for node 69becccea85a0f2cbb32d23b 2026-03-23 16:52:35,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:52:35,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becccea85a0f2cbb32d23b HTTP/1.1" 200 None 2026-03-23 16:52:35,149 - lava_callback - DEBUG - Processing node 69becccea85a0f2cbb32d23b: baseline-arm64-clabbe 2026-03-23 16:52:35,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becccea85a0f2cbb32d23b 2026-03-23 16:52:35,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:52:35,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becccea85a0f2cbb32d23b HTTP/1.1" 200 None 2026-03-23 16:52:35,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:52:35,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:52:35,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:52:35,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becccea85a0f2cbb32d23b HTTP/1.1" 200 None 2026-03-23 16:52:35,203 - lava_callback - ERROR - Error processing callback for node 69becccea85a0f2cbb32d23b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59602 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:56:43,420 - lava_callback - INFO - Received callback for node 69c16ca42b2b51e9ad97a079 INFO: 172.19.0.1:42582 - "POST /node/69c16ca42b2b51e9ad97a079 HTTP/1.0" 202 Accepted 2026-03-23 16:56:43,431 - lava_callback - INFO - Starting async job submit for node 69c16ca42b2b51e9ad97a079 2026-03-23 16:56:43,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:56:43,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca42b2b51e9ad97a079 HTTP/1.1" 200 None 2026-03-23 16:56:43,560 - lava_callback - DEBUG - Processing node 69c16ca42b2b51e9ad97a079: baseline-arm 2026-03-23 16:56:44,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:56:45,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:56:45,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca42b2b51e9ad97a079/log.txt.gz 2026-03-23 16:56:45,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:56:46,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:56:46,320 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca42b2b51e9ad97a079/lava-logs.yaml 2026-03-23 16:56:46,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:42594 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:56:46,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:56:46,838 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c16ca42b2b51e9ad97a079/lava_callback.json.gz DEBUG: Setup failed for 69c16ca42b2b51e9ad97a079. Transitting job node result: incomplete -> fail 2026-03-23 16:56:47,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:56:47,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16ca42b2b51e9ad97a079 HTTP/1.1" 200 None 2026-03-23 16:56:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:56:47,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:56:47,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:56:47,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16ca42b2b51e9ad97a079 HTTP/1.1" 200 None 2026-03-23 16:56:47,303 - lava_callback - INFO - Completed processing callback for node 69c16ca42b2b51e9ad97a079 2026-03-23 16:56:52,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:56:52,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39434 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:58:51,279 - lava_callback - INFO - Received callback for node 69c171372b2b51e9ad97a4b5 INFO: 172.19.0.1:59800 - "POST /node/69c171372b2b51e9ad97a4b5 HTTP/1.0" 202 Accepted 2026-03-23 16:58:51,285 - lava_callback - INFO - Starting async job submit for node 69c171372b2b51e9ad97a4b5 2026-03-23 16:58:51,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:58:51,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171372b2b51e9ad97a4b5 HTTP/1.1" 200 None 2026-03-23 16:58:51,305 - lava_callback - DEBUG - Processing node 69c171372b2b51e9ad97a4b5: baseline-arm 2026-03-23 16:58:51,310 - lava_callback - WARNING - Failed to upload log 2026-03-23 16:58:51,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:58:51,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:58:51,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c171372b2b51e9ad97a4b5/lava-logs.yaml 2026-03-23 16:58:51,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 16:58:51,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 16:58:51,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c171372b2b51e9ad97a4b5/lava_callback.json.gz 2026-03-23 16:58:51,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:58:51,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c171372b2b51e9ad97a4b5 HTTP/1.1" 200 None 2026-03-23 16:58:51,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:58:51,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 16:58:51,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:58:51,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c171372b2b51e9ad97a4b5 HTTP/1.1" 200 None 2026-03-23 16:58:51,773 - lava_callback - INFO - Completed processing callback for node 69c171372b2b51e9ad97a4b5 2026-03-23 16:58:52,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:58:52,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35298 - "GET / HTTP/1.0" 200 OK 2026-03-23 16:59:35,384 - lava_callback - INFO - Received callback for node 69bece65a85a0f2cbb32d2f0 INFO: 172.19.0.1:44656 - "POST /node/69bece65a85a0f2cbb32d2f0 HTTP/1.0" 202 Accepted 2026-03-23 16:59:35,389 - lava_callback - INFO - Starting async job submit for node 69bece65a85a0f2cbb32d2f0 2026-03-23 16:59:35,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:59:35,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bece65a85a0f2cbb32d2f0 HTTP/1.1" 200 None 2026-03-23 16:59:35,407 - lava_callback - DEBUG - Processing node 69bece65a85a0f2cbb32d2f0: baseline-arm64-clabbe 2026-03-23 16:59:35,407 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bece65a85a0f2cbb32d2f0 2026-03-23 16:59:35,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:59:35,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bece65a85a0f2cbb32d2f0 HTTP/1.1" 200 None 2026-03-23 16:59:35,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:59:35,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 16:59:35,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 16:59:35,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bece65a85a0f2cbb32d2f0 HTTP/1.1" 200 None 2026-03-23 16:59:35,462 - lava_callback - ERROR - Error processing callback for node 69bece65a85a0f2cbb32d2f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43112 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:05:35,545 - lava_callback - INFO - Received callback for node 69becfd3a85a0f2cbb32d3a1 INFO: 172.19.0.1:49338 - "POST /node/69becfd3a85a0f2cbb32d3a1 HTTP/1.0" 202 Accepted 2026-03-23 17:05:35,550 - lava_callback - INFO - Starting async job submit for node 69becfd3a85a0f2cbb32d3a1 2026-03-23 17:05:35,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:05:35,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becfd3a85a0f2cbb32d3a1 HTTP/1.1" 200 None 2026-03-23 17:05:35,577 - lava_callback - DEBUG - Processing node 69becfd3a85a0f2cbb32d3a1: baseline-arm64-clabbe 2026-03-23 17:05:35,577 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69becfd3a85a0f2cbb32d3a1 2026-03-23 17:05:35,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:05:35,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69becfd3a85a0f2cbb32d3a1 HTTP/1.1" 200 None 2026-03-23 17:05:35,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:05:35,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 17:05:35,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:05:35,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69becfd3a85a0f2cbb32d3a1 HTTP/1.1" 200 None 2026-03-23 17:05:35,640 - lava_callback - ERROR - Error processing callback for node 69becfd3a85a0f2cbb32d3a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40450 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 17:09:15,739 - lava_callback - INFO - Received callback for node 69bed0b0a85a0f2cbb32d3f3 INFO: 172.19.0.1:40454 - "POST /node/69bed0b0a85a0f2cbb32d3f3 HTTP/1.0" 202 Accepted 2026-03-23 17:09:15,745 - lava_callback - INFO - Starting async job submit for node 69bed0b0a85a0f2cbb32d3f3 2026-03-23 17:09:15,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:09:15,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed0b0a85a0f2cbb32d3f3 HTTP/1.1" 200 None 2026-03-23 17:09:15,763 - lava_callback - DEBUG - Processing node 69bed0b0a85a0f2cbb32d3f3: baseline-arm64-clabbe 2026-03-23 17:09:15,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bed0b0a85a0f2cbb32d3f3 2026-03-23 17:09:15,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:09:15,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed0b0a85a0f2cbb32d3f3 HTTP/1.1" 200 None 2026-03-23 17:09:15,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:09:15,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 17:09:15,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:09:15,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bed0b0a85a0f2cbb32d3f3 HTTP/1.1" 200 None 2026-03-23 17:09:15,818 - lava_callback - ERROR - Error processing callback for node 69bed0b0a85a0f2cbb32d3f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39038 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:10:37,017 - lava_callback - INFO - Received callback for node 69c1739c2b2b51e9ad97a578 INFO: 172.19.0.1:39044 - "POST /node/69c1739c2b2b51e9ad97a578 HTTP/1.0" 202 Accepted 2026-03-23 17:10:37,023 - lava_callback - INFO - Starting async job submit for node 69c1739c2b2b51e9ad97a578 2026-03-23 17:10:37,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:10:37,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1739c2b2b51e9ad97a578 HTTP/1.1" 200 None 2026-03-23 17:10:37,084 - lava_callback - DEBUG - Processing node 69c1739c2b2b51e9ad97a578: baseline-arm-pengutronix 2026-03-23 17:10:37,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:10:37,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:10:37,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c1739c2b2b51e9ad97a578/log.txt.gz 2026-03-23 17:10:37,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:10:37,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:10:37,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c1739c2b2b51e9ad97a578/lava-logs.yaml 2026-03-23 17:10:37,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:10:37,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:10:37,872 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c1739c2b2b51e9ad97a578/lava_callback.json.gz 2026-03-23 17:10:37,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:10:37,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1739c2b2b51e9ad97a578 HTTP/1.1" 200 None 2026-03-23 17:10:37,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:10:37,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 17:10:37,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:10:37,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1739c2b2b51e9ad97a578 HTTP/1.1" 200 None 2026-03-23 17:10:38,031 - lava_callback - INFO - Completed processing callback for node 69c1739c2b2b51e9ad97a578 INFO: 172.19.0.1:54230 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:10:52,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:10:52,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39306 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:11:35,878 - lava_callback - INFO - Received callback for node 69bed143a85a0f2cbb32d418 INFO: 172.19.0.1:52882 - "POST /node/69bed143a85a0f2cbb32d418 HTTP/1.0" 202 Accepted 2026-03-23 17:11:35,883 - lava_callback - INFO - Starting async job submit for node 69bed143a85a0f2cbb32d418 2026-03-23 17:11:35,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:11:35,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed143a85a0f2cbb32d418 HTTP/1.1" 200 None 2026-03-23 17:11:35,900 - lava_callback - DEBUG - Processing node 69bed143a85a0f2cbb32d418: baseline-arm64-clabbe 2026-03-23 17:11:35,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bed143a85a0f2cbb32d418 2026-03-23 17:11:35,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:11:35,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed143a85a0f2cbb32d418 HTTP/1.1" 200 None 2026-03-23 17:11:35,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:11:35,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 17:11:35,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:11:35,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bed143a85a0f2cbb32d418 HTTP/1.1" 200 None 2026-03-23 17:11:35,970 - lava_callback - ERROR - Error processing callback for node 69bed143a85a0f2cbb32d418: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58318 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 17:14:16,033 - lava_callback - INFO - Received callback for node 69bed1d8a85a0f2cbb32d437 INFO: 172.19.0.1:58328 - "POST /node/69bed1d8a85a0f2cbb32d437 HTTP/1.0" 202 Accepted 2026-03-23 17:14:16,038 - lava_callback - INFO - Starting async job submit for node 69bed1d8a85a0f2cbb32d437 2026-03-23 17:14:16,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:14:16,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed1d8a85a0f2cbb32d437 HTTP/1.1" 200 None 2026-03-23 17:14:16,054 - lava_callback - DEBUG - Processing node 69bed1d8a85a0f2cbb32d437: baseline-arm64-clabbe 2026-03-23 17:14:16,054 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bed1d8a85a0f2cbb32d437 2026-03-23 17:14:16,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:14:16,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed1d8a85a0f2cbb32d437 HTTP/1.1" 200 None 2026-03-23 17:14:16,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:14:16,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 17:14:16,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:14:16,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bed1d8a85a0f2cbb32d437 HTTP/1.1" 200 None 2026-03-23 17:14:16,113 - lava_callback - ERROR - Error processing callback for node 69bed1d8a85a0f2cbb32d437: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33052 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:35:18,611 - lava_callback - INFO - Received callback for node 69c179982b2b51e9ad97a784 INFO: 172.19.0.1:33060 - "POST /node/69c179982b2b51e9ad97a784 HTTP/1.0" 202 Accepted 2026-03-23 17:35:18,617 - lava_callback - INFO - Starting async job submit for node 69c179982b2b51e9ad97a784 2026-03-23 17:35:18,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:35:18,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c179982b2b51e9ad97a784 HTTP/1.1" 200 None 2026-03-23 17:35:18,659 - lava_callback - DEBUG - Processing node 69c179982b2b51e9ad97a784: baseline-arm-pengutronix 2026-03-23 17:35:18,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:35:18,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:35:18,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c179982b2b51e9ad97a784/log.txt.gz 2026-03-23 17:35:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:35:19,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:35:19,253 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c179982b2b51e9ad97a784/lava-logs.yaml 2026-03-23 17:35:19,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:35:19,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:35:19,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c179982b2b51e9ad97a784/lava_callback.json.gz 2026-03-23 17:35:19,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:35:19,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c179982b2b51e9ad97a784 HTTP/1.1" 200 None 2026-03-23 17:35:19,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:35:19,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 17:35:19,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:35:19,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c179982b2b51e9ad97a784 HTTP/1.1" 200 None 2026-03-23 17:35:19,482 - lava_callback - INFO - Completed processing callback for node 69c179982b2b51e9ad97a784 2026-03-23 17:35:22,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:35:22,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60306 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:44:40,625 - lava_callback - INFO - Received callback for node 69c16cc72b2b51e9ad97a0f2 INFO: 172.19.0.1:38120 - "POST /node/69c16cc72b2b51e9ad97a0f2 HTTP/1.0" 202 Accepted 2026-03-23 17:44:40,673 - lava_callback - INFO - Starting async job submit for node 69c16cc72b2b51e9ad97a0f2 2026-03-23 17:44:40,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:44:40,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc72b2b51e9ad97a0f2 HTTP/1.1" 200 None 2026-03-23 17:44:40,713 - lava_callback - DEBUG - Processing node 69c16cc72b2b51e9ad97a0f2: baseline-arm-pengutronix 2026-03-23 17:44:40,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:44:40,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:44:40,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc72b2b51e9ad97a0f2/log.txt.gz 2026-03-23 17:44:41,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:44:41,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:44:41,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc72b2b51e9ad97a0f2/lava-logs.yaml 2026-03-23 17:44:41,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:44:41,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:44:41,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c16cc72b2b51e9ad97a0f2/lava_callback.json.gz DEBUG: Setup failed for 69c16cc72b2b51e9ad97a0f2. Transitting job node result: incomplete -> fail 2026-03-23 17:44:41,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:44:41,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16cc72b2b51e9ad97a0f2 HTTP/1.1" 200 None 2026-03-23 17:44:41,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:44:41,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 17:44:41,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:44:41,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16cc72b2b51e9ad97a0f2 HTTP/1.1" 200 None 2026-03-23 17:44:41,572 - lava_callback - INFO - Completed processing callback for node 69c16cc72b2b51e9ad97a0f2 INFO: 172.19.0.1:38134 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:44:52,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:44:52,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47354 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:45:14,385 - lava_callback - INFO - Received callback for node 69c177932b2b51e9ad97a6f5 INFO: 172.19.0.1:43618 - "POST /node/69c177932b2b51e9ad97a6f5 HTTP/1.0" 202 Accepted 2026-03-23 17:45:14,392 - lava_callback - INFO - Starting async job submit for node 69c177932b2b51e9ad97a6f5 2026-03-23 17:45:14,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:45:14,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177932b2b51e9ad97a6f5 HTTP/1.1" 200 None 2026-03-23 17:45:14,479 - lava_callback - DEBUG - Processing node 69c177932b2b51e9ad97a6f5: ltp-smoke 2026-03-23 17:45:14,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:45:15,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:45:15,084 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c177932b2b51e9ad97a6f5/log.txt.gz INFO: 172.19.0.1:43634 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 17:45:15,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:45:15,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:45:15,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c177932b2b51e9ad97a6f5/lava-logs.yaml 2026-03-23 17:45:15,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:45:15,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:45:15,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c177932b2b51e9ad97a6f5/lava_callback.json.gz 2026-03-23 17:45:15,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:45:15,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c177932b2b51e9ad97a6f5 HTTP/1.1" 200 None 2026-03-23 17:45:15,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:45:15,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1678e2b2b51e9ad97794c HTTP/1.1" 200 None 2026-03-23 17:45:15,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:45:15,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c177932b2b51e9ad97a6f5 HTTP/1.1" 200 None 2026-03-23 17:45:16,118 - lava_callback - INFO - Completed processing callback for node 69c177932b2b51e9ad97a6f5 INFO: 172.19.0.1:43648 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:45:22,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:45:22,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36148 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:46:37,820 - lava_callback - INFO - Received callback for node 69c178632b2b51e9ad97a723 INFO: 172.19.0.1:36152 - "POST /node/69c178632b2b51e9ad97a723 HTTP/1.0" 202 Accepted 2026-03-23 17:46:37,827 - lava_callback - INFO - Starting async job submit for node 69c178632b2b51e9ad97a723 2026-03-23 17:46:37,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:46:37,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178632b2b51e9ad97a723 HTTP/1.1" 200 None 2026-03-23 17:46:37,895 - lava_callback - DEBUG - Processing node 69c178632b2b51e9ad97a723: baseline-arm 2026-03-23 17:46:38,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:46:38,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:46:38,630 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c178632b2b51e9ad97a723/log.txt.gz 2026-03-23 17:46:38,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:46:39,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:46:39,317 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c178632b2b51e9ad97a723/lava-logs.yaml 2026-03-23 17:46:39,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:46:39,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:46:39,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c178632b2b51e9ad97a723/lava_callback.json.gz DEBUG: Setup failed for 69c178632b2b51e9ad97a723. Transitting job node result: incomplete -> fail 2026-03-23 17:46:39,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:46:39,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c178632b2b51e9ad97a723 HTTP/1.1" 200 None 2026-03-23 17:46:39,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:46:39,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 17:46:39,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:46:39,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c178632b2b51e9ad97a723 HTTP/1.1" 200 None 2026-03-23 17:46:39,828 - lava_callback - INFO - Completed processing callback for node 69c178632b2b51e9ad97a723 INFO: 172.19.0.1:34828 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:46:52,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:46:52,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45526 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:47:50,636 - lava_callback - INFO - Received callback for node 69bed9b8a85a0f2cbb32d66b INFO: 172.19.0.1:51718 - "POST /node/69bed9b8a85a0f2cbb32d66b HTTP/1.0" 202 Accepted 2026-03-23 17:47:50,641 - lava_callback - INFO - Starting async job submit for node 69bed9b8a85a0f2cbb32d66b 2026-03-23 17:47:50,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:47:50,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed9b8a85a0f2cbb32d66b HTTP/1.1" 200 None 2026-03-23 17:47:50,657 - lava_callback - DEBUG - Processing node 69bed9b8a85a0f2cbb32d66b: baseline-arm-baylibre 2026-03-23 17:47:50,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bed9b8a85a0f2cbb32d66b 2026-03-23 17:47:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:47:50,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed9b8a85a0f2cbb32d66b HTTP/1.1" 200 None 2026-03-23 17:47:50,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:47:50,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:47:50,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:47:50,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bed9b8a85a0f2cbb32d66b HTTP/1.1" 200 None 2026-03-23 17:47:50,714 - lava_callback - ERROR - Error processing callback for node 69bed9b8a85a0f2cbb32d66b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33562 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:48:30,514 - lava_callback - INFO - Received callback for node 69bed9dda85a0f2cbb32d696 INFO: 172.19.0.1:35564 - "POST /node/69bed9dda85a0f2cbb32d696 HTTP/1.0" 202 Accepted 2026-03-23 17:48:30,519 - lava_callback - INFO - Starting async job submit for node 69bed9dda85a0f2cbb32d696 2026-03-23 17:48:30,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:48:30,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed9dda85a0f2cbb32d696 HTTP/1.1" 200 None 2026-03-23 17:48:30,551 - lava_callback - DEBUG - Processing node 69bed9dda85a0f2cbb32d696: baseline-arm-baylibre 2026-03-23 17:48:30,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bed9dda85a0f2cbb32d696 2026-03-23 17:48:30,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:48:30,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bed9dda85a0f2cbb32d696 HTTP/1.1" 200 None 2026-03-23 17:48:30,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:48:30,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:48:30,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:48:30,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bed9dda85a0f2cbb32d696 HTTP/1.1" 200 None 2026-03-23 17:48:30,628 - lava_callback - ERROR - Error processing callback for node 69bed9dda85a0f2cbb32d696: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49160 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:49:10,545 - lava_callback - INFO - Received callback for node 69beda01a85a0f2cbb32d69f INFO: 172.19.0.1:40522 - "POST /node/69beda01a85a0f2cbb32d69f HTTP/1.0" 202 Accepted 2026-03-23 17:49:10,550 - lava_callback - INFO - Starting async job submit for node 69beda01a85a0f2cbb32d69f 2026-03-23 17:49:10,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:10,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda01a85a0f2cbb32d69f HTTP/1.1" 200 None 2026-03-23 17:49:10,568 - lava_callback - DEBUG - Processing node 69beda01a85a0f2cbb32d69f: baseline-arm-baylibre 2026-03-23 17:49:10,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beda01a85a0f2cbb32d69f 2026-03-23 17:49:10,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:10,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda01a85a0f2cbb32d69f HTTP/1.1" 200 None 2026-03-23 17:49:10,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:10,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:49:10,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:10,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beda01a85a0f2cbb32d69f HTTP/1.1" 200 None 2026-03-23 17:49:10,618 - lava_callback - ERROR - Error processing callback for node 69beda01a85a0f2cbb32d69f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37922 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:49:30,593 - lava_callback - INFO - Received callback for node 69beda25a85a0f2cbb32d6a9 INFO: 172.19.0.1:45184 - "POST /node/69beda25a85a0f2cbb32d6a9 HTTP/1.0" 202 Accepted 2026-03-23 17:49:30,599 - lava_callback - INFO - Starting async job submit for node 69beda25a85a0f2cbb32d6a9 2026-03-23 17:49:30,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:30,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda25a85a0f2cbb32d6a9 HTTP/1.1" 200 None 2026-03-23 17:49:30,614 - lava_callback - DEBUG - Processing node 69beda25a85a0f2cbb32d6a9: baseline-arm-baylibre 2026-03-23 17:49:30,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beda25a85a0f2cbb32d6a9 2026-03-23 17:49:30,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:30,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda25a85a0f2cbb32d6a9 HTTP/1.1" 200 None 2026-03-23 17:49:30,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:30,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:49:30,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:49:30,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beda25a85a0f2cbb32d6a9 HTTP/1.1" 200 None 2026-03-23 17:49:30,672 - lava_callback - ERROR - Error processing callback for node 69beda25a85a0f2cbb32d6a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47596 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:50:17,499 - lava_callback - INFO - Received callback for node 69beda4ba85a0f2cbb32d6b7 INFO: 172.19.0.1:47606 - "POST /node/69beda4ba85a0f2cbb32d6b7 HTTP/1.0" 202 Accepted 2026-03-23 17:50:17,505 - lava_callback - INFO - Starting async job submit for node 69beda4ba85a0f2cbb32d6b7 2026-03-23 17:50:17,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:17,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda4ba85a0f2cbb32d6b7 HTTP/1.1" 200 None 2026-03-23 17:50:17,524 - lava_callback - DEBUG - Processing node 69beda4ba85a0f2cbb32d6b7: baseline-arm-clabbe 2026-03-23 17:50:17,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beda4ba85a0f2cbb32d6b7 2026-03-23 17:50:17,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:17,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda4ba85a0f2cbb32d6b7 HTTP/1.1" 200 None 2026-03-23 17:50:17,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:17,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:50:17,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:17,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beda4ba85a0f2cbb32d6b7 HTTP/1.1" 200 None 2026-03-23 17:50:17,604 - lava_callback - ERROR - Error processing callback for node 69beda4ba85a0f2cbb32d6b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38466 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:50:50,664 - lava_callback - INFO - Received callback for node 69beda6da85a0f2cbb32d6c9 INFO: 172.19.0.1:52872 - "POST /node/69beda6da85a0f2cbb32d6c9 HTTP/1.0" 202 Accepted 2026-03-23 17:50:50,673 - lava_callback - INFO - Starting async job submit for node 69beda6da85a0f2cbb32d6c9 2026-03-23 17:50:50,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:50,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda6da85a0f2cbb32d6c9 HTTP/1.1" 200 None 2026-03-23 17:50:50,703 - lava_callback - DEBUG - Processing node 69beda6da85a0f2cbb32d6c9: baseline-arm-baylibre 2026-03-23 17:50:50,703 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beda6da85a0f2cbb32d6c9 2026-03-23 17:50:50,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:50,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda6da85a0f2cbb32d6c9 HTTP/1.1" 200 None 2026-03-23 17:50:50,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:50,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:50:50,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:50:50,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beda6da85a0f2cbb32d6c9 HTTP/1.1" 200 None 2026-03-23 17:50:50,787 - lava_callback - ERROR - Error processing callback for node 69beda6da85a0f2cbb32d6c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50920 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:51:17,570 - lava_callback - INFO - Received callback for node 69beda93a85a0f2cbb32d6dc INFO: 172.19.0.1:50922 - "POST /node/69beda93a85a0f2cbb32d6dc HTTP/1.0" 202 Accepted 2026-03-23 17:51:17,576 - lava_callback - INFO - Starting async job submit for node 69beda93a85a0f2cbb32d6dc 2026-03-23 17:51:17,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:51:17,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda93a85a0f2cbb32d6dc HTTP/1.1" 200 None 2026-03-23 17:51:17,594 - lava_callback - DEBUG - Processing node 69beda93a85a0f2cbb32d6dc: baseline-arm-clabbe 2026-03-23 17:51:17,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beda93a85a0f2cbb32d6dc 2026-03-23 17:51:17,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:51:17,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beda93a85a0f2cbb32d6dc HTTP/1.1" 200 None 2026-03-23 17:51:17,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:51:17,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:51:17,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:51:17,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beda93a85a0f2cbb32d6dc HTTP/1.1" 200 None 2026-03-23 17:51:17,662 - lava_callback - ERROR - Error processing callback for node 69beda93a85a0f2cbb32d6dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56716 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:52:10,739 - lava_callback - INFO - Received callback for node 69bedab6a85a0f2cbb32d6e5 INFO: 172.19.0.1:55208 - "POST /node/69bedab6a85a0f2cbb32d6e5 HTTP/1.0" 202 Accepted 2026-03-23 17:52:10,745 - lava_callback - INFO - Starting async job submit for node 69bedab6a85a0f2cbb32d6e5 2026-03-23 17:52:10,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:10,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedab6a85a0f2cbb32d6e5 HTTP/1.1" 200 None 2026-03-23 17:52:10,762 - lava_callback - DEBUG - Processing node 69bedab6a85a0f2cbb32d6e5: baseline-arm-baylibre 2026-03-23 17:52:10,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bedab6a85a0f2cbb32d6e5 2026-03-23 17:52:10,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:10,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedab6a85a0f2cbb32d6e5 HTTP/1.1" 200 None 2026-03-23 17:52:10,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:10,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:52:10,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:10,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bedab6a85a0f2cbb32d6e5 HTTP/1.1" 200 None 2026-03-23 17:52:10,824 - lava_callback - ERROR - Error processing callback for node 69bedab6a85a0f2cbb32d6e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42514 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:52:37,558 - lava_callback - INFO - Received callback for node 69bedadaa85a0f2cbb32d6f7 INFO: 172.19.0.1:42520 - "POST /node/69bedadaa85a0f2cbb32d6f7 HTTP/1.0" 202 Accepted 2026-03-23 17:52:37,568 - lava_callback - INFO - Starting async job submit for node 69bedadaa85a0f2cbb32d6f7 2026-03-23 17:52:37,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:37,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedadaa85a0f2cbb32d6f7 HTTP/1.1" 200 None 2026-03-23 17:52:37,603 - lava_callback - DEBUG - Processing node 69bedadaa85a0f2cbb32d6f7: baseline-arm-clabbe 2026-03-23 17:52:37,603 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bedadaa85a0f2cbb32d6f7 2026-03-23 17:52:37,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:37,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedadaa85a0f2cbb32d6f7 HTTP/1.1" 200 None 2026-03-23 17:52:37,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:37,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:52:37,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:52:37,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bedadaa85a0f2cbb32d6f7 HTTP/1.1" 200 None 2026-03-23 17:52:37,695 - lava_callback - ERROR - Error processing callback for node 69bedadaa85a0f2cbb32d6f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47096 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:53:17,568 - lava_callback - INFO - Received callback for node 69bedafea85a0f2cbb32d706 INFO: 172.19.0.1:47100 - "POST /node/69bedafea85a0f2cbb32d706 HTTP/1.0" 202 Accepted 2026-03-23 17:53:17,573 - lava_callback - INFO - Starting async job submit for node 69bedafea85a0f2cbb32d706 2026-03-23 17:53:17,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:53:17,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedafea85a0f2cbb32d706 HTTP/1.1" 200 None 2026-03-23 17:53:17,592 - lava_callback - DEBUG - Processing node 69bedafea85a0f2cbb32d706: baseline-arm-clabbe 2026-03-23 17:53:17,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bedafea85a0f2cbb32d706 2026-03-23 17:53:17,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:53:17,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedafea85a0f2cbb32d706 HTTP/1.1" 200 None 2026-03-23 17:53:17,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:53:17,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:53:17,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:53:17,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bedafea85a0f2cbb32d706 HTTP/1.1" 200 None 2026-03-23 17:53:17,645 - lava_callback - ERROR - Error processing callback for node 69bedafea85a0f2cbb32d706: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42700 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:54:57,655 - lava_callback - INFO - Received callback for node 69bedb6ca85a0f2cbb32d720 INFO: 172.19.0.1:42714 - "POST /node/69bedb6ca85a0f2cbb32d720 HTTP/1.0" 202 Accepted 2026-03-23 17:54:57,661 - lava_callback - INFO - Starting async job submit for node 69bedb6ca85a0f2cbb32d720 2026-03-23 17:54:57,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:54:57,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedb6ca85a0f2cbb32d720 HTTP/1.1" 200 None 2026-03-23 17:54:57,678 - lava_callback - DEBUG - Processing node 69bedb6ca85a0f2cbb32d720: baseline-arm-clabbe 2026-03-23 17:54:57,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bedb6ca85a0f2cbb32d720 2026-03-23 17:54:57,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:54:57,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bedb6ca85a0f2cbb32d720 HTTP/1.1" 200 None 2026-03-23 17:54:57,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:54:57,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 17:54:57,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:54:57,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bedb6ca85a0f2cbb32d720 HTTP/1.1" 200 None 2026-03-23 17:54:57,772 - lava_callback - ERROR - Error processing callback for node 69bedb6ca85a0f2cbb32d720: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48252 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:56:08,289 - lava_callback - INFO - Received callback for node 69c17e902b2b51e9ad97a8b3 INFO: 172.19.0.1:48254 - "POST /node/69c17e902b2b51e9ad97a8b3 HTTP/1.0" 202 Accepted 2026-03-23 17:56:08,300 - lava_callback - INFO - Starting async job submit for node 69c17e902b2b51e9ad97a8b3 2026-03-23 17:56:08,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:08,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e902b2b51e9ad97a8b3 HTTP/1.1" 200 None 2026-03-23 17:56:08,359 - lava_callback - DEBUG - Processing node 69c17e902b2b51e9ad97a8b3: baseline-arm64 2026-03-23 17:56:08,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:08,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:08,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e902b2b51e9ad97a8b3/log.txt.gz 2026-03-23 17:56:08,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:09,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:09,099 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e902b2b51e9ad97a8b3/lava-logs.yaml 2026-03-23 17:56:09,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:09,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:09,236 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e902b2b51e9ad97a8b3/lava_callback.json.gz 2026-03-23 17:56:09,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:09,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e902b2b51e9ad97a8b3 HTTP/1.1" 200 None 2026-03-23 17:56:09,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:09,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:56:09,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:09,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e902b2b51e9ad97a8b3 HTTP/1.1" 200 None 2026-03-23 17:56:09,358 - lava_callback - INFO - Completed processing callback for node 69c17e902b2b51e9ad97a8b3 INFO: 172.19.0.1:34596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34606 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:56:22,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:22,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 17:56:22,905 - lava_callback - INFO - Received callback for node 69c17eac2b2b51e9ad97a90f INFO: 172.19.0.1:57612 - "POST /node/69c17eac2b2b51e9ad97a90f HTTP/1.0" 202 Accepted 2026-03-23 17:56:22,920 - lava_callback - INFO - Starting async job submit for node 69c17eac2b2b51e9ad97a90f 2026-03-23 17:56:22,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:22,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eac2b2b51e9ad97a90f HTTP/1.1" 200 None 2026-03-23 17:56:22,947 - lava_callback - DEBUG - Processing node 69c17eac2b2b51e9ad97a90f: baseline-nfs-arm64 2026-03-23 17:56:22,948 - lava_callback - WARNING - Failed to upload log 2026-03-23 17:56:22,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:23,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:23,120 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eac2b2b51e9ad97a90f/lava-logs.yaml 2026-03-23 17:56:23,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:23,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:23,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eac2b2b51e9ad97a90f/lava_callback.json.gz 2026-03-23 17:56:23,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:23,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eac2b2b51e9ad97a90f HTTP/1.1" 200 None 2026-03-23 17:56:23,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:23,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:56:23,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:23,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eac2b2b51e9ad97a90f HTTP/1.1" 200 None 2026-03-23 17:56:23,314 - lava_callback - INFO - Completed processing callback for node 69c17eac2b2b51e9ad97a90f 2026-03-23 17:56:24,776 - lava_callback - INFO - Received callback for node 69c17e9c2b2b51e9ad97a8d4 INFO: 172.19.0.1:57618 - "POST /node/69c17e9c2b2b51e9ad97a8d4 HTTP/1.0" 202 Accepted 2026-03-23 17:56:24,786 - lava_callback - INFO - Starting async job submit for node 69c17e9c2b2b51e9ad97a8d4 2026-03-23 17:56:24,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:24,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9c2b2b51e9ad97a8d4 HTTP/1.1" 200 None 2026-03-23 17:56:24,838 - lava_callback - DEBUG - Processing node 69c17e9c2b2b51e9ad97a8d4: baseline-arm64 2026-03-23 17:56:24,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:25,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:25,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9c2b2b51e9ad97a8d4/log.txt.gz 2026-03-23 17:56:25,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:25,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:25,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9c2b2b51e9ad97a8d4/lava-logs.yaml 2026-03-23 17:56:25,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:25,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:25,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9c2b2b51e9ad97a8d4/lava_callback.json.gz 2026-03-23 17:56:25,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:25,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9c2b2b51e9ad97a8d4 HTTP/1.1" 200 None 2026-03-23 17:56:25,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:25,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:56:25,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:25,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e9c2b2b51e9ad97a8d4 HTTP/1.1" 200 None 2026-03-23 17:56:25,761 - lava_callback - INFO - Completed processing callback for node 69c17e9c2b2b51e9ad97a8d4 INFO: 172.19.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36858 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:56:38,076 - lava_callback - INFO - Received callback for node 69c17e9a2b2b51e9ad97a8ce INFO: 172.19.0.1:36864 - "POST /node/69c17e9a2b2b51e9ad97a8ce HTTP/1.0" 202 Accepted 2026-03-23 17:56:38,082 - lava_callback - INFO - Starting async job submit for node 69c17e9a2b2b51e9ad97a8ce 2026-03-23 17:56:38,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:38,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9a2b2b51e9ad97a8ce HTTP/1.1" 200 None 2026-03-23 17:56:38,121 - lava_callback - DEBUG - Processing node 69c17e9a2b2b51e9ad97a8ce: baseline-arm64 2026-03-23 17:56:38,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:38,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:38,729 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9a2b2b51e9ad97a8ce/log.txt.gz 2026-03-23 17:56:38,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:39,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:39,191 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9a2b2b51e9ad97a8ce/lava-logs.yaml 2026-03-23 17:56:39,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:39,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:39,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9a2b2b51e9ad97a8ce/lava_callback.json.gz 2026-03-23 17:56:39,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:39,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9a2b2b51e9ad97a8ce HTTP/1.1" 200 None 2026-03-23 17:56:39,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:39,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:56:39,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:39,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e9a2b2b51e9ad97a8ce HTTP/1.1" 200 None 2026-03-23 17:56:39,450 - lava_callback - INFO - Completed processing callback for node 69c17e9a2b2b51e9ad97a8ce INFO: 172.19.0.1:55392 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:56:46,774 - lava_callback - INFO - Received callback for node 69c17e9b2b2b51e9ad97a8d1 INFO: 172.19.0.1:55398 - "POST /node/69c17e9b2b2b51e9ad97a8d1 HTTP/1.0" 202 Accepted 2026-03-23 17:56:46,780 - lava_callback - INFO - Starting async job submit for node 69c17e9b2b2b51e9ad97a8d1 2026-03-23 17:56:46,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:46,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9b2b2b51e9ad97a8d1 HTTP/1.1" 200 None 2026-03-23 17:56:46,817 - lava_callback - DEBUG - Processing node 69c17e9b2b2b51e9ad97a8d1: baseline-arm64 2026-03-23 17:56:47,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:47,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:47,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9b2b2b51e9ad97a8d1/log.txt.gz 2026-03-23 17:56:47,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:47,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:47,968 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9b2b2b51e9ad97a8d1/lava-logs.yaml 2026-03-23 17:56:47,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:48,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:48,156 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9b2b2b51e9ad97a8d1/lava_callback.json.gz 2026-03-23 17:56:48,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:48,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9b2b2b51e9ad97a8d1 HTTP/1.1" 200 None 2026-03-23 17:56:48,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:48,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:56:48,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:48,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e9b2b2b51e9ad97a8d1 HTTP/1.1" 200 None 2026-03-23 17:56:48,248 - lava_callback - INFO - Completed processing callback for node 69c17e9b2b2b51e9ad97a8d1 2026-03-23 17:56:50,929 - lava_callback - INFO - Received callback for node 69c17e922b2b51e9ad97a8b9 INFO: 172.19.0.1:37568 - "POST /node/69c17e922b2b51e9ad97a8b9 HTTP/1.0" 202 Accepted 2026-03-23 17:56:50,936 - lava_callback - INFO - Starting async job submit for node 69c17e922b2b51e9ad97a8b9 2026-03-23 17:56:50,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:50,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e922b2b51e9ad97a8b9 HTTP/1.1" 200 None 2026-03-23 17:56:50,975 - lava_callback - DEBUG - Processing node 69c17e922b2b51e9ad97a8b9: baseline-arm64 2026-03-23 17:56:51,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:51,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:51,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e922b2b51e9ad97a8b9/log.txt.gz 2026-03-23 17:56:51,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:51,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:51,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e922b2b51e9ad97a8b9/lava-logs.yaml 2026-03-23 17:56:51,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:56:52,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:56:52,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e922b2b51e9ad97a8b9/lava_callback.json.gz 2026-03-23 17:56:52,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:52,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e922b2b51e9ad97a8b9 HTTP/1.1" 200 None 2026-03-23 17:56:52,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:52,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:56:52,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:52,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e922b2b51e9ad97a8b9 HTTP/1.1" 200 None 2026-03-23 17:56:52,087 - lava_callback - INFO - Completed processing callback for node 69c17e922b2b51e9ad97a8b9 2026-03-23 17:56:52,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:56:52,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:37582 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:57:00,310 - lava_callback - INFO - Received callback for node 69c17e952b2b51e9ad97a8c2 INFO: 172.19.0.1:40796 - "POST /node/69c17e952b2b51e9ad97a8c2 HTTP/1.0" 202 Accepted 2026-03-23 17:57:00,317 - lava_callback - INFO - Starting async job submit for node 69c17e952b2b51e9ad97a8c2 2026-03-23 17:57:00,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:00,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e952b2b51e9ad97a8c2 HTTP/1.1" 200 None 2026-03-23 17:57:00,366 - lava_callback - DEBUG - Processing node 69c17e952b2b51e9ad97a8c2: baseline-arm64 2026-03-23 17:57:00,529 - lava_callback - WARNING - Failed to upload log 2026-03-23 17:57:00,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:00,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:00,774 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e952b2b51e9ad97a8c2/lava-logs.yaml 2026-03-23 17:57:00,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:01,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:01,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e952b2b51e9ad97a8c2/lava_callback.json.gz 2026-03-23 17:57:01,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:01,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e952b2b51e9ad97a8c2 HTTP/1.1" 200 None 2026-03-23 17:57:01,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:01,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:01,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:01,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e952b2b51e9ad97a8c2 HTTP/1.1" 200 None 2026-03-23 17:57:01,236 - lava_callback - INFO - Completed processing callback for node 69c17e952b2b51e9ad97a8c2 INFO: 172.19.0.1:40808 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:57:04,317 - lava_callback - INFO - Received callback for node 69c17e942b2b51e9ad97a8bf INFO: 172.19.0.1:40814 - "POST /node/69c17e942b2b51e9ad97a8bf HTTP/1.0" 202 Accepted 2026-03-23 17:57:04,325 - lava_callback - INFO - Starting async job submit for node 69c17e942b2b51e9ad97a8bf 2026-03-23 17:57:04,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:04,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e942b2b51e9ad97a8bf HTTP/1.1" 200 None 2026-03-23 17:57:04,375 - lava_callback - DEBUG - Processing node 69c17e942b2b51e9ad97a8bf: baseline-arm64 2026-03-23 17:57:04,512 - lava_callback - WARNING - Failed to upload log 2026-03-23 17:57:04,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:04,715 - lava_callback - INFO - Received callback for node 69c17e912b2b51e9ad97a8b6 INFO: 172.19.0.1:40820 - "POST /node/69c17e912b2b51e9ad97a8b6 HTTP/1.0" 202 Accepted 2026-03-23 17:57:04,722 - lava_callback - INFO - Starting async job submit for node 69c17e912b2b51e9ad97a8b6 2026-03-23 17:57:04,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:04,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:04,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e912b2b51e9ad97a8b6 HTTP/1.1" 200 None 2026-03-23 17:57:04,764 - lava_callback - DEBUG - Processing node 69c17e912b2b51e9ad97a8b6: baseline-arm64 2026-03-23 17:57:04,769 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e942b2b51e9ad97a8bf/lava-logs.yaml 2026-03-23 17:57:04,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:05,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:05,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:05,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e942b2b51e9ad97a8bf/lava_callback.json.gz 2026-03-23 17:57:05,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:05,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e942b2b51e9ad97a8bf HTTP/1.1" 200 None 2026-03-23 17:57:05,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:05,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:05,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:05,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e912b2b51e9ad97a8b6/log.txt.gz 2026-03-23 17:57:05,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e942b2b51e9ad97a8bf HTTP/1.1" 200 None 2026-03-23 17:57:05,422 - lava_callback - INFO - Completed processing callback for node 69c17e942b2b51e9ad97a8bf 2026-03-23 17:57:05,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:05,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:05,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e912b2b51e9ad97a8b6/lava-logs.yaml 2026-03-23 17:57:05,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:05,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:05,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e912b2b51e9ad97a8b6/lava_callback.json.gz 2026-03-23 17:57:05,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e912b2b51e9ad97a8b6 HTTP/1.1" 200 None 2026-03-23 17:57:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:05,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:05,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:05,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e912b2b51e9ad97a8b6 HTTP/1.1" 200 None 2026-03-23 17:57:05,888 - lava_callback - INFO - Completed processing callback for node 69c17e912b2b51e9ad97a8b6 INFO: 172.19.0.1:40824 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:57:06,698 - lava_callback - INFO - Received callback for node 69c17ea12b2b51e9ad97a8f4 INFO: 172.19.0.1:40828 - "POST /node/69c17ea12b2b51e9ad97a8f4 HTTP/1.0" 202 Accepted 2026-03-23 17:57:06,705 - lava_callback - INFO - Starting async job submit for node 69c17ea12b2b51e9ad97a8f4 2026-03-23 17:57:06,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:06,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea12b2b51e9ad97a8f4 HTTP/1.1" 200 None 2026-03-23 17:57:06,744 - lava_callback - DEBUG - Processing node 69c17ea12b2b51e9ad97a8f4: baseline-arm64 2026-03-23 17:57:07,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:07,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:07,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea12b2b51e9ad97a8f4/log.txt.gz 2026-03-23 17:57:07,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:07,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:07,555 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea12b2b51e9ad97a8f4/lava-logs.yaml 2026-03-23 17:57:07,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:07,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:07,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea12b2b51e9ad97a8f4/lava_callback.json.gz 2026-03-23 17:57:07,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:07,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea12b2b51e9ad97a8f4 HTTP/1.1" 200 None 2026-03-23 17:57:07,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:07,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:07,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:07,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea12b2b51e9ad97a8f4 HTTP/1.1" 200 None 2026-03-23 17:57:07,781 - lava_callback - INFO - Completed processing callback for node 69c17ea12b2b51e9ad97a8f4 INFO: 172.19.0.1:38748 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 17:57:15,612 - lava_callback - INFO - Received callback for node 69c17e992b2b51e9ad97a8cb INFO: 172.19.0.1:38762 - "POST /node/69c17e992b2b51e9ad97a8cb HTTP/1.0" 202 Accepted 2026-03-23 17:57:15,619 - lava_callback - INFO - Starting async job submit for node 69c17e992b2b51e9ad97a8cb 2026-03-23 17:57:15,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:15,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e992b2b51e9ad97a8cb HTTP/1.1" 200 None 2026-03-23 17:57:15,655 - lava_callback - DEBUG - Processing node 69c17e992b2b51e9ad97a8cb: baseline-arm64 2026-03-23 17:57:16,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:16,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:16,157 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e992b2b51e9ad97a8cb/log.txt.gz 2026-03-23 17:57:16,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:38772 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:57:16,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:16,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e992b2b51e9ad97a8cb/lava-logs.yaml 2026-03-23 17:57:16,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:16,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:16,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e992b2b51e9ad97a8cb/lava_callback.json.gz 2026-03-23 17:57:16,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:16,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e992b2b51e9ad97a8cb HTTP/1.1" 200 None 2026-03-23 17:57:16,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:16,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:16,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:16,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e992b2b51e9ad97a8cb HTTP/1.1" 200 None 2026-03-23 17:57:16,823 - lava_callback - INFO - Completed processing callback for node 69c17e992b2b51e9ad97a8cb 2026-03-23 17:57:17,717 - lava_callback - INFO - Received callback for node 69c17e9d2b2b51e9ad97a8d7 INFO: 172.19.0.1:38782 - "POST /node/69c17e9d2b2b51e9ad97a8d7 HTTP/1.0" 202 Accepted 2026-03-23 17:57:17,724 - lava_callback - INFO - Starting async job submit for node 69c17e9d2b2b51e9ad97a8d7 2026-03-23 17:57:17,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:17,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9d2b2b51e9ad97a8d7 HTTP/1.1" 200 None 2026-03-23 17:57:17,788 - lava_callback - DEBUG - Processing node 69c17e9d2b2b51e9ad97a8d7: baseline-arm64 2026-03-23 17:57:18,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:18,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:18,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9d2b2b51e9ad97a8d7/log.txt.gz 2026-03-23 17:57:18,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:18,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:18,937 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9d2b2b51e9ad97a8d7/lava-logs.yaml 2026-03-23 17:57:18,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:19,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:19,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9d2b2b51e9ad97a8d7/lava_callback.json.gz 2026-03-23 17:57:19,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:19,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9d2b2b51e9ad97a8d7 HTTP/1.1" 200 None 2026-03-23 17:57:19,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:19,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:19,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:19,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e9d2b2b51e9ad97a8d7 HTTP/1.1" 200 None 2026-03-23 17:57:19,250 - lava_callback - INFO - Completed processing callback for node 69c17e9d2b2b51e9ad97a8d7 2026-03-23 17:57:22,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:22,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 17:57:25,304 - lava_callback - INFO - Received callback for node 69c17e982b2b51e9ad97a8c8 INFO: 172.19.0.1:44236 - "POST /node/69c17e982b2b51e9ad97a8c8 HTTP/1.0" 202 Accepted 2026-03-23 17:57:25,317 - lava_callback - INFO - Starting async job submit for node 69c17e982b2b51e9ad97a8c8 2026-03-23 17:57:25,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e982b2b51e9ad97a8c8 HTTP/1.1" 200 None 2026-03-23 17:57:25,387 - lava_callback - DEBUG - Processing node 69c17e982b2b51e9ad97a8c8: baseline-arm64 2026-03-23 17:57:25,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:26,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:26,049 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e982b2b51e9ad97a8c8/log.txt.gz 2026-03-23 17:57:26,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:44242 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:57:26,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:26,553 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e982b2b51e9ad97a8c8/lava-logs.yaml 2026-03-23 17:57:26,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:26,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:26,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e982b2b51e9ad97a8c8/lava_callback.json.gz 2026-03-23 17:57:26,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:26,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e982b2b51e9ad97a8c8 HTTP/1.1" 200 None 2026-03-23 17:57:26,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:27,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:27,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:27,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e982b2b51e9ad97a8c8 HTTP/1.1" 200 None 2026-03-23 17:57:27,057 - lava_callback - INFO - Completed processing callback for node 69c17e982b2b51e9ad97a8c8 2026-03-23 17:57:33,071 - lava_callback - INFO - Received callback for node 69c17eb02b2b51e9ad97a918 INFO: 172.19.0.1:41658 - "POST /node/69c17eb02b2b51e9ad97a918 HTTP/1.0" 202 Accepted 2026-03-23 17:57:33,078 - lava_callback - INFO - Starting async job submit for node 69c17eb02b2b51e9ad97a918 2026-03-23 17:57:33,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:33,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb02b2b51e9ad97a918 HTTP/1.1" 200 None 2026-03-23 17:57:33,147 - lava_callback - DEBUG - Processing node 69c17eb02b2b51e9ad97a918: baseline-nfs-arm64 2026-03-23 17:57:33,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:33,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:33,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb02b2b51e9ad97a918/log.txt.gz 2026-03-23 17:57:34,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:34,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:34,537 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb02b2b51e9ad97a918/lava-logs.yaml 2026-03-23 17:57:34,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:34,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:34,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb02b2b51e9ad97a918/lava_callback.json.gz 2026-03-23 17:57:34,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:34,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb02b2b51e9ad97a918 HTTP/1.1" 200 None 2026-03-23 17:57:34,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:34,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:35,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:35,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb02b2b51e9ad97a918 HTTP/1.1" 200 None 2026-03-23 17:57:35,043 - lava_callback - INFO - Completed processing callback for node 69c17eb02b2b51e9ad97a918 INFO: 172.19.0.1:41666 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:57:37,034 - lava_callback - INFO - Received callback for node 69c17e932b2b51e9ad97a8bc INFO: 172.19.0.1:41680 - "POST /node/69c17e932b2b51e9ad97a8bc HTTP/1.0" 202 Accepted 2026-03-23 17:57:37,042 - lava_callback - INFO - Starting async job submit for node 69c17e932b2b51e9ad97a8bc 2026-03-23 17:57:37,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:37,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e932b2b51e9ad97a8bc HTTP/1.1" 200 None 2026-03-23 17:57:37,100 - lava_callback - DEBUG - Processing node 69c17e932b2b51e9ad97a8bc: baseline-arm64 2026-03-23 17:57:37,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:37,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:37,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e932b2b51e9ad97a8bc/log.txt.gz 2026-03-23 17:57:37,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:38,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:38,268 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e932b2b51e9ad97a8bc/lava-logs.yaml 2026-03-23 17:57:38,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:38,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:38,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e932b2b51e9ad97a8bc/lava_callback.json.gz 2026-03-23 17:57:38,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:38,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e932b2b51e9ad97a8bc HTTP/1.1" 200 None 2026-03-23 17:57:38,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:38,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:38,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:38,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e932b2b51e9ad97a8bc HTTP/1.1" 200 None 2026-03-23 17:57:38,629 - lava_callback - INFO - Completed processing callback for node 69c17e932b2b51e9ad97a8bc 2026-03-23 17:57:39,002 - lava_callback - INFO - Received callback for node 69c17eaa2b2b51e9ad97a909 INFO: 172.19.0.1:41690 - "POST /node/69c17eaa2b2b51e9ad97a909 HTTP/1.0" 202 Accepted 2026-03-23 17:57:39,012 - lava_callback - INFO - Starting async job submit for node 69c17eaa2b2b51e9ad97a909 2026-03-23 17:57:39,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:39,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eaa2b2b51e9ad97a909 HTTP/1.1" 200 None 2026-03-23 17:57:39,093 - lava_callback - DEBUG - Processing node 69c17eaa2b2b51e9ad97a909: baseline-nfs-arm64 2026-03-23 17:57:39,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:40,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:40,108 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eaa2b2b51e9ad97a909/log.txt.gz 2026-03-23 17:57:40,306 - lava_callback - INFO - Received callback for node 69c17ea02b2b51e9ad97a8f1 INFO: 172.19.0.1:36938 - "POST /node/69c17ea02b2b51e9ad97a8f1 HTTP/1.0" 202 Accepted 2026-03-23 17:57:40,331 - lava_callback - INFO - Starting async job submit for node 69c17ea02b2b51e9ad97a8f1 2026-03-23 17:57:40,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:40,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea02b2b51e9ad97a8f1 HTTP/1.1" 200 None 2026-03-23 17:57:40,468 - lava_callback - DEBUG - Processing node 69c17ea02b2b51e9ad97a8f1: baseline-arm64 2026-03-23 17:57:40,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:40,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:41,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:41,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eaa2b2b51e9ad97a909/lava-logs.yaml 2026-03-23 17:57:41,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:41,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:41,403 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea02b2b51e9ad97a8f1/log.txt.gz 2026-03-23 17:57:41,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:41,602 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eaa2b2b51e9ad97a909/lava_callback.json.gz 2026-03-23 17:57:41,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:41,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:41,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eaa2b2b51e9ad97a909 HTTP/1.1" 200 None 2026-03-23 17:57:41,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:41,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:41,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:41,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eaa2b2b51e9ad97a909 HTTP/1.1" 200 None 2026-03-23 17:57:41,749 - lava_callback - INFO - Completed processing callback for node 69c17eaa2b2b51e9ad97a909 2026-03-23 17:57:42,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:42,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea02b2b51e9ad97a8f1/lava-logs.yaml 2026-03-23 17:57:42,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:42,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:42,427 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea02b2b51e9ad97a8f1/lava_callback.json.gz 2026-03-23 17:57:42,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:42,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea02b2b51e9ad97a8f1 HTTP/1.1" 200 None 2026-03-23 17:57:42,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:42,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:42,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:42,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea02b2b51e9ad97a8f1 HTTP/1.1" 200 None 2026-03-23 17:57:42,681 - lava_callback - INFO - Completed processing callback for node 69c17ea02b2b51e9ad97a8f1 2026-03-23 17:57:45,358 - lava_callback - INFO - Received callback for node 69c17ea82b2b51e9ad97a903 INFO: 172.19.0.1:36948 - "POST /node/69c17ea82b2b51e9ad97a903 HTTP/1.0" 202 Accepted 2026-03-23 17:57:45,369 - lava_callback - INFO - Starting async job submit for node 69c17ea82b2b51e9ad97a903 2026-03-23 17:57:45,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:45,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea82b2b51e9ad97a903 HTTP/1.1" 200 None 2026-03-23 17:57:45,449 - lava_callback - DEBUG - Processing node 69c17ea82b2b51e9ad97a903: baseline-nfs-arm64 2026-03-23 17:57:45,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:46,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:46,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea82b2b51e9ad97a903/log.txt.gz INFO: 172.19.0.1:36962 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:57:46,605 - lava_callback - INFO - Received callback for node 69c17eae2b2b51e9ad97a912 INFO: 172.19.0.1:36976 - "POST /node/69c17eae2b2b51e9ad97a912 HTTP/1.0" 202 Accepted 2026-03-23 17:57:46,625 - lava_callback - INFO - Starting async job submit for node 69c17eae2b2b51e9ad97a912 2026-03-23 17:57:46,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:46,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:46,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eae2b2b51e9ad97a912 HTTP/1.1" 200 None 2026-03-23 17:57:46,772 - lava_callback - DEBUG - Processing node 69c17eae2b2b51e9ad97a912: baseline-nfs-arm64 2026-03-23 17:57:47,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:47,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea82b2b51e9ad97a903/lava-logs.yaml 2026-03-23 17:57:47,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:47,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:47,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:47,670 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eae2b2b51e9ad97a912/log.txt.gz 2026-03-23 17:57:47,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:47,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea82b2b51e9ad97a903/lava_callback.json.gz 2026-03-23 17:57:47,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:47,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea82b2b51e9ad97a903 HTTP/1.1" 200 None 2026-03-23 17:57:47,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:47,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:47,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:48,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea82b2b51e9ad97a903 HTTP/1.1" 200 None 2026-03-23 17:57:48,092 - lava_callback - INFO - Completed processing callback for node 69c17ea82b2b51e9ad97a903 2026-03-23 17:57:48,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:48,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:48,588 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eae2b2b51e9ad97a912/lava-logs.yaml 2026-03-23 17:57:48,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:49,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:49,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eae2b2b51e9ad97a912/lava_callback.json.gz 2026-03-23 17:57:49,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:49,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eae2b2b51e9ad97a912 HTTP/1.1" 200 None 2026-03-23 17:57:49,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:49,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:49,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:49,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eae2b2b51e9ad97a912 HTTP/1.1" 200 None 2026-03-23 17:57:49,193 - lava_callback - INFO - Completed processing callback for node 69c17eae2b2b51e9ad97a912 2026-03-23 17:57:50,598 - lava_callback - INFO - Received callback for node 69c17ed92b2b51e9ad97a999 INFO: 172.19.0.1:34366 - "POST /node/69c17ed92b2b51e9ad97a999 HTTP/1.0" 202 Accepted 2026-03-23 17:57:50,608 - lava_callback - INFO - Starting async job submit for node 69c17ed92b2b51e9ad97a999 2026-03-23 17:57:50,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:50,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed92b2b51e9ad97a999 HTTP/1.1" 200 None 2026-03-23 17:57:50,663 - lava_callback - DEBUG - Processing node 69c17ed92b2b51e9ad97a999: baseline-arm64-pengutronix 2026-03-23 17:57:50,853 - lava_callback - INFO - Received callback for node 69c17ea52b2b51e9ad97a8fd INFO: 172.19.0.1:34380 - "POST /node/69c17ea52b2b51e9ad97a8fd HTTP/1.0" 202 Accepted 2026-03-23 17:57:50,883 - lava_callback - INFO - Starting async job submit for node 69c17ea52b2b51e9ad97a8fd 2026-03-23 17:57:50,923 - lava_callback - INFO - Received callback for node 69c17edb2b2b51e9ad97a9ba 2026-03-23 17:57:50,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:50,955 - lava_callback - INFO - Starting async job submit for node 69c17edb2b2b51e9ad97a9ba INFO: 172.19.0.1:34394 - "POST /node/69c17edb2b2b51e9ad97a9ba HTTP/1.0" 202 Accepted 2026-03-23 17:57:51,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:51,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea52b2b51e9ad97a8fd HTTP/1.1" 200 None 2026-03-23 17:57:51,075 - lava_callback - DEBUG - Processing node 69c17ea52b2b51e9ad97a8fd: baseline-nfs-arm64 2026-03-23 17:57:51,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:51,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17edb2b2b51e9ad97a9ba HTTP/1.1" 200 None 2026-03-23 17:57:51,123 - lava_callback - DEBUG - Processing node 69c17edb2b2b51e9ad97a9ba: baseline-arm64-foundriesio 2026-03-23 17:57:51,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:51,619 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17ed92b2b51e9ad97a999/log.txt.gz 2026-03-23 17:57:52,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:52,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:52,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:52,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:52,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c17edb2b2b51e9ad97a9ba/log.txt.gz 2026-03-23 17:57:52,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:52,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea52b2b51e9ad97a8fd/log.txt.gz 2026-03-23 17:57:52,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:52,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:52,815 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17ed92b2b51e9ad97a999/lava-logs.yaml 2026-03-23 17:57:52,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 17:57:52,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:52,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:52,994 - lava_callback - INFO - Received callback for node 69c17f1a2b2b51e9ad97aa25 2026-03-23 17:57:53,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:53,003 - lava_callback - INFO - Starting async job submit for node 69c17f1a2b2b51e9ad97aa25 INFO: 172.19.0.1:34402 - "POST /node/69c17f1a2b2b51e9ad97aa25 HTTP/1.0" 202 Accepted 2026-03-23 17:57:53,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:53,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17f1a2b2b51e9ad97aa25 HTTP/1.1" 200 None 2026-03-23 17:57:53,049 - lava_callback - DEBUG - Processing node 69c17f1a2b2b51e9ad97aa25: baseline-nfs-arm64 2026-03-23 17:57:53,052 - lava_callback - WARNING - Failed to upload log 2026-03-23 17:57:53,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:53,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:53,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17ed92b2b51e9ad97a999/lava_callback.json.gz 2026-03-23 17:57:53,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:53,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17f1a2b2b51e9ad97aa25/lava-logs.yaml 2026-03-23 17:57:53,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:53,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:53,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:53,638 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c17edb2b2b51e9ad97a9ba/lava-logs.yaml 2026-03-23 17:57:53,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed92b2b51e9ad97a999 HTTP/1.1" 200 None 2026-03-23 17:57:53,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:53,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:53,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:53,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:53,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:53,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea52b2b51e9ad97a8fd/lava-logs.yaml 2026-03-23 17:57:53,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:57:53,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed92b2b51e9ad97a999 HTTP/1.1" 200 None 2026-03-23 17:57:53,726 - lava_callback - INFO - Completed processing callback for node 69c17ed92b2b51e9ad97a999 2026-03-23 17:57:53,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:53,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17f1a2b2b51e9ad97aa25/lava_callback.json.gz 2026-03-23 17:57:53,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:53,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17f1a2b2b51e9ad97aa25 HTTP/1.1" 200 None 2026-03-23 17:57:53,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:53,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:53,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:53,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17f1a2b2b51e9ad97aa25 HTTP/1.1" 200 None 2026-03-23 17:57:53,892 - lava_callback - INFO - Completed processing callback for node 69c17f1a2b2b51e9ad97aa25 2026-03-23 17:57:53,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:53,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c17edb2b2b51e9ad97a9ba/lava_callback.json.gz 2026-03-23 17:57:53,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:54,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17edb2b2b51e9ad97a9ba HTTP/1.1" 200 None 2026-03-23 17:57:54,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:54,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:54,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:54,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17edb2b2b51e9ad97a9ba HTTP/1.1" 200 None 2026-03-23 17:57:54,112 - lava_callback - INFO - Completed processing callback for node 69c17edb2b2b51e9ad97a9ba 2026-03-23 17:57:54,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:57:54,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea52b2b51e9ad97a8fd/lava_callback.json.gz 2026-03-23 17:57:54,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:54,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea52b2b51e9ad97a8fd HTTP/1.1" 200 None 2026-03-23 17:57:54,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:54,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:57:54,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:57:54,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea52b2b51e9ad97a8fd HTTP/1.1" 200 None 2026-03-23 17:57:54,645 - lava_callback - INFO - Completed processing callback for node 69c17ea52b2b51e9ad97a8fd INFO: 172.19.0.1:34414 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:58:00,527 - lava_callback - INFO - Received callback for node 69c17eda2b2b51e9ad97a99c INFO: 172.19.0.1:60512 - "POST /node/69c17eda2b2b51e9ad97a99c HTTP/1.0" 202 Accepted 2026-03-23 17:58:00,534 - lava_callback - INFO - Starting async job submit for node 69c17eda2b2b51e9ad97a99c 2026-03-23 17:58:00,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:00,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eda2b2b51e9ad97a99c HTTP/1.1" 200 None 2026-03-23 17:58:00,576 - lava_callback - DEBUG - Processing node 69c17eda2b2b51e9ad97a99c: baseline-arm64-pengutronix 2026-03-23 17:58:00,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:01,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:01,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17eda2b2b51e9ad97a99c/log.txt.gz 2026-03-23 17:58:01,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:01,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:01,581 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17eda2b2b51e9ad97a99c/lava-logs.yaml 2026-03-23 17:58:01,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:02,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:02,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17eda2b2b51e9ad97a99c/lava_callback.json.gz 2026-03-23 17:58:02,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:02,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eda2b2b51e9ad97a99c HTTP/1.1" 200 None 2026-03-23 17:58:02,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:02,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:58:02,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:02,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eda2b2b51e9ad97a99c HTTP/1.1" 200 None 2026-03-23 17:58:02,181 - lava_callback - INFO - Completed processing callback for node 69c17eda2b2b51e9ad97a99c INFO: 172.19.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39626 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:58:18,832 - lava_callback - INFO - Received callback for node 69c17edc2b2b51e9ad97a9bd INFO: 172.19.0.1:39640 - "POST /node/69c17edc2b2b51e9ad97a9bd HTTP/1.0" 202 Accepted 2026-03-23 17:58:18,844 - lava_callback - INFO - Starting async job submit for node 69c17edc2b2b51e9ad97a9bd 2026-03-23 17:58:18,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:18,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17edc2b2b51e9ad97a9bd HTTP/1.1" 200 None 2026-03-23 17:58:18,919 - lava_callback - DEBUG - Processing node 69c17edc2b2b51e9ad97a9bd: baseline-arm64-foundriesio 2026-03-23 17:58:19,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:19,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:19,753 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c17edc2b2b51e9ad97a9bd/log.txt.gz 2026-03-23 17:58:20,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:20,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:20,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c17edc2b2b51e9ad97a9bd/lava-logs.yaml 2026-03-23 17:58:20,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:20,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:20,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69c17edc2b2b51e9ad97a9bd/lava_callback.json.gz 2026-03-23 17:58:20,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:20,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17edc2b2b51e9ad97a9bd HTTP/1.1" 200 None 2026-03-23 17:58:20,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:20,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:58:20,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:20,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17edc2b2b51e9ad97a9bd HTTP/1.1" 200 None 2026-03-23 17:58:20,942 - lava_callback - INFO - Completed processing callback for node 69c17edc2b2b51e9ad97a9bd 2026-03-23 17:58:21,282 - lava_callback - INFO - Received callback for node 69c17eb12b2b51e9ad97a91b INFO: 172.19.0.1:35156 - "POST /node/69c17eb12b2b51e9ad97a91b HTTP/1.0" 202 Accepted 2026-03-23 17:58:21,296 - lava_callback - INFO - Starting async job submit for node 69c17eb12b2b51e9ad97a91b 2026-03-23 17:58:21,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:21,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb12b2b51e9ad97a91b HTTP/1.1" 200 None 2026-03-23 17:58:21,367 - lava_callback - DEBUG - Processing node 69c17eb12b2b51e9ad97a91b: baseline-nfs-arm64 2026-03-23 17:58:21,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:22,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:22,053 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb12b2b51e9ad97a91b/log.txt.gz 2026-03-23 17:58:22,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:22,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:22,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb12b2b51e9ad97a91b/lava-logs.yaml 2026-03-23 17:58:22,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:22,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:22,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb12b2b51e9ad97a91b/lava_callback.json.gz 2026-03-23 17:58:22,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:22,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb12b2b51e9ad97a91b HTTP/1.1" 200 None 2026-03-23 17:58:22,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:22,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:58:22,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:22,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:22,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb12b2b51e9ad97a91b HTTP/1.1" 200 None 2026-03-23 17:58:22,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-23 17:58:22,968 - lava_callback - INFO - Completed processing callback for node 69c17eb12b2b51e9ad97a91b 2026-03-23 17:58:23,813 - lava_callback - INFO - Received callback for node 69c17eab2b2b51e9ad97a90c INFO: 172.19.0.1:35158 - "POST /node/69c17eab2b2b51e9ad97a90c HTTP/1.0" 202 Accepted 2026-03-23 17:58:23,821 - lava_callback - INFO - Starting async job submit for node 69c17eab2b2b51e9ad97a90c 2026-03-23 17:58:23,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:23,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eab2b2b51e9ad97a90c HTTP/1.1" 200 None 2026-03-23 17:58:23,927 - lava_callback - DEBUG - Processing node 69c17eab2b2b51e9ad97a90c: baseline-nfs-arm64 2026-03-23 17:58:24,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:25,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:25,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eab2b2b51e9ad97a90c/log.txt.gz 2026-03-23 17:58:25,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:25,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:25,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eab2b2b51e9ad97a90c/lava-logs.yaml 2026-03-23 17:58:25,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:26,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:26,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eab2b2b51e9ad97a90c/lava_callback.json.gz 2026-03-23 17:58:26,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:26,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eab2b2b51e9ad97a90c HTTP/1.1" 200 None 2026-03-23 17:58:26,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:26,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:58:26,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:26,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eab2b2b51e9ad97a90c HTTP/1.1" 200 None 2026-03-23 17:58:26,402 - lava_callback - INFO - Completed processing callback for node 69c17eab2b2b51e9ad97a90c INFO: 172.19.0.1:35168 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:58:36,255 - lava_callback - INFO - Received callback for node 69c17ece2b2b51e9ad97a979 INFO: 172.19.0.1:34172 - "POST /node/69c17ece2b2b51e9ad97a979 HTTP/1.0" 202 Accepted 2026-03-23 17:58:36,262 - lava_callback - INFO - Starting async job submit for node 69c17ece2b2b51e9ad97a979 2026-03-23 17:58:36,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:36,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ece2b2b51e9ad97a979 HTTP/1.1" 200 None 2026-03-23 17:58:36,301 - lava_callback - DEBUG - Processing node 69c17ece2b2b51e9ad97a979: baseline-arm64-broonie INFO: 172.19.0.1:34174 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:58:36,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:36,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:36,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ece2b2b51e9ad97a979/log.txt.gz 2026-03-23 17:58:37,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:37,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:37,502 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ece2b2b51e9ad97a979/lava-logs.yaml 2026-03-23 17:58:37,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:37,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:37,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ece2b2b51e9ad97a979/lava_callback.json.gz 2026-03-23 17:58:37,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:37,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ece2b2b51e9ad97a979 HTTP/1.1" 200 None 2026-03-23 17:58:37,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:37,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:58:37,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:37,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ece2b2b51e9ad97a979 HTTP/1.1" 200 None 2026-03-23 17:58:37,794 - lava_callback - INFO - Completed processing callback for node 69c17ece2b2b51e9ad97a979 2026-03-23 17:58:41,453 - lava_callback - INFO - Received callback for node 69c17ed72b2b51e9ad97a996 INFO: 172.19.0.1:44620 - "POST /node/69c17ed72b2b51e9ad97a996 HTTP/1.0" 202 Accepted 2026-03-23 17:58:41,459 - lava_callback - INFO - Starting async job submit for node 69c17ed72b2b51e9ad97a996 2026-03-23 17:58:41,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:41,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed72b2b51e9ad97a996 HTTP/1.1" 200 None 2026-03-23 17:58:41,516 - lava_callback - DEBUG - Processing node 69c17ed72b2b51e9ad97a996: baseline-arm64-pengutronix 2026-03-23 17:58:41,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:42,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:42,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17ed72b2b51e9ad97a996/log.txt.gz 2026-03-23 17:58:42,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:42,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:42,384 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17ed72b2b51e9ad97a996/lava-logs.yaml 2026-03-23 17:58:42,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:58:42,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:58:42,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c17ed72b2b51e9ad97a996/lava_callback.json.gz 2026-03-23 17:58:42,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:42,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed72b2b51e9ad97a996 HTTP/1.1" 200 None 2026-03-23 17:58:42,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:42,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:58:42,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:42,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed72b2b51e9ad97a996 HTTP/1.1" 200 None 2026-03-23 17:58:43,028 - lava_callback - INFO - Completed processing callback for node 69c17ed72b2b51e9ad97a996 INFO: 172.19.0.1:44630 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:58:52,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:58:52,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37476 - "GET / HTTP/1.0" 200 OK 2026-03-23 17:59:19,678 - lava_callback - INFO - Received callback for node 69c17e962b2b51e9ad97a8c5 INFO: 172.19.0.1:37484 - "POST /node/69c17e962b2b51e9ad97a8c5 HTTP/1.0" 202 Accepted 2026-03-23 17:59:19,687 - lava_callback - INFO - Starting async job submit for node 69c17e962b2b51e9ad97a8c5 2026-03-23 17:59:19,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:59:19,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e962b2b51e9ad97a8c5 HTTP/1.1" 200 None 2026-03-23 17:59:19,751 - lava_callback - DEBUG - Processing node 69c17e962b2b51e9ad97a8c5: baseline-arm64 2026-03-23 17:59:20,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:59:20,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:59:20,402 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e962b2b51e9ad97a8c5/log.txt.gz 2026-03-23 17:59:20,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:59:20,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:59:20,960 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e962b2b51e9ad97a8c5/lava-logs.yaml 2026-03-23 17:59:20,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 17:59:21,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 17:59:21,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e962b2b51e9ad97a8c5/lava_callback.json.gz 2026-03-23 17:59:21,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:59:21,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e962b2b51e9ad97a8c5 HTTP/1.1" 200 None 2026-03-23 17:59:21,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:59:21,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 17:59:21,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:59:21,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e962b2b51e9ad97a8c5 HTTP/1.1" 200 None 2026-03-23 17:59:21,626 - lava_callback - INFO - Completed processing callback for node 69c17e962b2b51e9ad97a8c5 2026-03-23 17:59:22,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 17:59:23,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59228 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:00:28,668 - lava_callback - INFO - Received callback for node 69c17ea62b2b51e9ad97a900 INFO: 172.19.0.1:59240 - "POST /node/69c17ea62b2b51e9ad97a900 HTTP/1.0" 202 Accepted 2026-03-23 18:00:28,675 - lava_callback - INFO - Starting async job submit for node 69c17ea62b2b51e9ad97a900 2026-03-23 18:00:28,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:00:28,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea62b2b51e9ad97a900 HTTP/1.1" 200 None 2026-03-23 18:00:28,710 - lava_callback - DEBUG - Processing node 69c17ea62b2b51e9ad97a900: baseline-nfs-arm64 2026-03-23 18:00:29,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:00:29,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:00:29,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea62b2b51e9ad97a900/log.txt.gz 2026-03-23 18:00:29,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:00:29,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:00:29,777 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea62b2b51e9ad97a900/lava-logs.yaml 2026-03-23 18:00:29,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:00:29,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:00:29,957 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea62b2b51e9ad97a900/lava_callback.json.gz 2026-03-23 18:00:29,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:00:29,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea62b2b51e9ad97a900 HTTP/1.1" 200 None 2026-03-23 18:00:29,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:00:30,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:00:30,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:00:30,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea62b2b51e9ad97a900 HTTP/1.1" 200 None 2026-03-23 18:00:30,046 - lava_callback - INFO - Completed processing callback for node 69c17ea62b2b51e9ad97a900 INFO: 172.19.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33074 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:00:53,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:00:53,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47376 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:02:30,533 - lava_callback - INFO - Received callback for node 69c17fbe2b2b51e9ad97aaa3 INFO: 172.19.0.1:48472 - "POST /node/69c17fbe2b2b51e9ad97aaa3 HTTP/1.0" 202 Accepted 2026-03-23 18:02:30,541 - lava_callback - INFO - Starting async job submit for node 69c17fbe2b2b51e9ad97aaa3 2026-03-23 18:02:30,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:30,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17fbe2b2b51e9ad97aaa3 HTTP/1.1" 200 None 2026-03-23 18:02:30,605 - lava_callback - DEBUG - Processing node 69c17fbe2b2b51e9ad97aaa3: baseline-arm64 2026-03-23 18:02:30,802 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:02:30,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:02:31,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:02:31,126 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17fbe2b2b51e9ad97aaa3/lava-logs.yaml 2026-03-23 18:02:31,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:02:31,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:02:31,267 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17fbe2b2b51e9ad97aaa3/lava_callback.json.gz 2026-03-23 18:02:31,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:31,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17fbe2b2b51e9ad97aaa3 HTTP/1.1" 200 None 2026-03-23 18:02:31,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:31,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:02:31,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:31,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17fbe2b2b51e9ad97aaa3 HTTP/1.1" 200 None 2026-03-23 18:02:31,421 - lava_callback - INFO - Completed processing callback for node 69c17fbe2b2b51e9ad97aaa3 INFO: 172.19.0.1:48476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39028 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:02:52,587 - lava_callback - INFO - Received callback for node 69c17c802b2b51e9ad97a806 INFO: 172.19.0.1:50784 - "POST /node/69c17c802b2b51e9ad97a806 HTTP/1.0" 202 Accepted 2026-03-23 18:02:52,595 - lava_callback - INFO - Starting async job submit for node 69c17c802b2b51e9ad97a806 2026-03-23 18:02:52,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:52,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17c802b2b51e9ad97a806 HTTP/1.1" 200 None 2026-03-23 18:02:52,685 - lava_callback - DEBUG - Processing node 69c17c802b2b51e9ad97a806: baseline-arm 2026-03-23 18:02:53,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:53,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 18:02:53,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:02:53,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:02:53,437 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c17c802b2b51e9ad97a806/log.txt.gz 2026-03-23 18:02:53,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:02:53,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:02:53,990 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c17c802b2b51e9ad97a806/lava-logs.yaml 2026-03-23 18:02:54,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:02:54,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:02:54,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c17c802b2b51e9ad97a806/lava_callback.json.gz DEBUG: Setup failed for 69c17c802b2b51e9ad97a806. Transitting job node result: incomplete -> fail 2026-03-23 18:02:54,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:54,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17c802b2b51e9ad97a806 HTTP/1.1" 200 None 2026-03-23 18:02:54,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:54,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 18:02:54,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:54,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17c802b2b51e9ad97a806 HTTP/1.1" 200 None 2026-03-23 18:02:54,452 - lava_callback - INFO - Completed processing callback for node 69c17c802b2b51e9ad97a806 INFO: 172.19.0.1:50798 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:02:58,436 - lava_callback - INFO - Received callback for node 69c180132b2b51e9ad97aaba INFO: 172.19.0.1:50804 - "POST /node/69c180132b2b51e9ad97aaba HTTP/1.0" 202 Accepted 2026-03-23 18:02:58,443 - lava_callback - INFO - Starting async job submit for node 69c180132b2b51e9ad97aaba 2026-03-23 18:02:58,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:58,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c180132b2b51e9ad97aaba HTTP/1.1" 200 None 2026-03-23 18:02:58,488 - lava_callback - DEBUG - Processing node 69c180132b2b51e9ad97aaba: baseline-arm64 2026-03-23 18:02:58,624 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:02:58,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:02:58,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:02:58,879 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c180132b2b51e9ad97aaba/lava-logs.yaml 2026-03-23 18:02:58,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:02:59,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:02:59,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c180132b2b51e9ad97aaba/lava_callback.json.gz 2026-03-23 18:02:59,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:59,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c180132b2b51e9ad97aaba HTTP/1.1" 200 None 2026-03-23 18:02:59,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:59,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:02:59,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:02:59,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c180132b2b51e9ad97aaba HTTP/1.1" 200 None 2026-03-23 18:02:59,171 - lava_callback - INFO - Completed processing callback for node 69c180132b2b51e9ad97aaba INFO: 172.19.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59244 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:03:22,511 - lava_callback - INFO - Received callback for node 69c17ea42b2b51e9ad97a8fa INFO: 172.19.0.1:47340 - "POST /node/69c17ea42b2b51e9ad97a8fa HTTP/1.0" 202 Accepted 2026-03-23 18:03:22,518 - lava_callback - INFO - Starting async job submit for node 69c17ea42b2b51e9ad97a8fa 2026-03-23 18:03:22,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:03:22,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea42b2b51e9ad97a8fa HTTP/1.1" 200 None 2026-03-23 18:03:22,572 - lava_callback - DEBUG - Processing node 69c17ea42b2b51e9ad97a8fa: baseline-arm64 2026-03-23 18:03:22,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:03:23,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:03:23,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea42b2b51e9ad97a8fa/log.txt.gz 2026-03-23 18:03:23,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:03:23,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-23 18:03:23,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:03:23,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:03:23,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea42b2b51e9ad97a8fa/lava-logs.yaml 2026-03-23 18:03:23,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:03:23,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:03:23,694 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea42b2b51e9ad97a8fa/lava_callback.json.gz DEBUG: Setup failed for 69c17ea42b2b51e9ad97a8fa. Transitting job node result: incomplete -> fail 2026-03-23 18:03:23,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:03:23,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea42b2b51e9ad97a8fa HTTP/1.1" 200 None 2026-03-23 18:03:23,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:03:23,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:03:23,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:03:23,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea42b2b51e9ad97a8fa HTTP/1.1" 200 None 2026-03-23 18:03:23,916 - lava_callback - INFO - Completed processing callback for node 69c17ea42b2b51e9ad97a8fa INFO: 172.19.0.1:47354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57182 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:03:53,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:03:53,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53262 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:04:32,992 - lava_callback - INFO - Received callback for node 69c1806c2b2b51e9ad97aaf7 INFO: 172.19.0.1:60056 - "POST /node/69c1806c2b2b51e9ad97aaf7 HTTP/1.0" 202 Accepted 2026-03-23 18:04:32,999 - lava_callback - INFO - Starting async job submit for node 69c1806c2b2b51e9ad97aaf7 2026-03-23 18:04:33,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:04:33,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1806c2b2b51e9ad97aaf7 HTTP/1.1" 200 None 2026-03-23 18:04:33,058 - lava_callback - DEBUG - Processing node 69c1806c2b2b51e9ad97aaf7: baseline-arm64 2026-03-23 18:04:33,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:04:33,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:04:33,519 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1806c2b2b51e9ad97aaf7/log.txt.gz 2026-03-23 18:04:33,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:04:33,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:04:33,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1806c2b2b51e9ad97aaf7/lava-logs.yaml 2026-03-23 18:04:33,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:04:34,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:04:34,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1806c2b2b51e9ad97aaf7/lava_callback.json.gz 2026-03-23 18:04:34,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:04:34,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1806c2b2b51e9ad97aaf7 HTTP/1.1" 200 None 2026-03-23 18:04:34,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:04:34,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:04:34,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:04:34,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1806c2b2b51e9ad97aaf7 HTTP/1.1" 200 None 2026-03-23 18:04:34,188 - lava_callback - INFO - Completed processing callback for node 69c1806c2b2b51e9ad97aaf7 INFO: 172.19.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42568 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:04:53,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:04:53,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58870 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:05:03,954 - lava_callback - INFO - Received callback for node 69c180c02b2b51e9ad97ab22 INFO: 172.19.0.1:58880 - "POST /node/69c180c02b2b51e9ad97ab22 HTTP/1.0" 202 Accepted 2026-03-23 18:05:03,959 - lava_callback - INFO - Starting async job submit for node 69c180c02b2b51e9ad97ab22 2026-03-23 18:05:03,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:05:03,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c180c02b2b51e9ad97ab22 HTTP/1.1" 200 None 2026-03-23 18:05:03,976 - lava_callback - DEBUG - Processing node 69c180c02b2b51e9ad97ab22: baseline-nfs-arm64 2026-03-23 18:05:03,977 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:05:03,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:05:04,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:05:04,121 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c180c02b2b51e9ad97ab22/lava-logs.yaml 2026-03-23 18:05:04,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:05:04,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:05:04,269 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c180c02b2b51e9ad97ab22/lava_callback.json.gz 2026-03-23 18:05:04,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:05:04,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c180c02b2b51e9ad97ab22 HTTP/1.1" 200 None 2026-03-23 18:05:04,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:05:04,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:05:04,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:05:04,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c180c02b2b51e9ad97ab22 HTTP/1.1" 200 None 2026-03-23 18:05:04,338 - lava_callback - INFO - Completed processing callback for node 69c180c02b2b51e9ad97ab22 INFO: 172.19.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35522 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:05:23,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:05:23,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53184 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:06:21,843 - lava_callback - INFO - Received callback for node 69c17e9f2b2b51e9ad97a8ee INFO: 172.19.0.1:33742 - "POST /node/69c17e9f2b2b51e9ad97a8ee HTTP/1.0" 202 Accepted 2026-03-23 18:06:21,850 - lava_callback - INFO - Starting async job submit for node 69c17e9f2b2b51e9ad97a8ee 2026-03-23 18:06:21,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:06:21,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9f2b2b51e9ad97a8ee HTTP/1.1" 200 None 2026-03-23 18:06:21,889 - lava_callback - DEBUG - Processing node 69c17e9f2b2b51e9ad97a8ee: baseline-arm64 2026-03-23 18:06:22,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:06:22,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:06:22,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9f2b2b51e9ad97a8ee/log.txt.gz 2026-03-23 18:06:22,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:06:23,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:06:23,007 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9f2b2b51e9ad97a8ee/lava-logs.yaml 2026-03-23 18:06:23,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:06:23,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:06:23,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17e9f2b2b51e9ad97a8ee/lava_callback.json.gz 2026-03-23 18:06:23,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:06:23,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17e9f2b2b51e9ad97a8ee HTTP/1.1" 200 None 2026-03-23 18:06:23,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:06:23,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:06:23,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:06:23,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17e9f2b2b51e9ad97a8ee HTTP/1.1" 200 None 2026-03-23 18:06:23,403 - lava_callback - INFO - Completed processing callback for node 69c17e9f2b2b51e9ad97a8ee INFO: 172.19.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46434 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:06:53,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:06:53,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38980 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:07:12,022 - lava_callback - INFO - Received callback for node 69c17eaf2b2b51e9ad97a915 INFO: 172.19.0.1:46020 - "POST /node/69c17eaf2b2b51e9ad97a915 HTTP/1.0" 202 Accepted 2026-03-23 18:07:12,029 - lava_callback - INFO - Starting async job submit for node 69c17eaf2b2b51e9ad97a915 2026-03-23 18:07:12,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:12,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eaf2b2b51e9ad97a915 HTTP/1.1" 200 None 2026-03-23 18:07:12,069 - lava_callback - DEBUG - Processing node 69c17eaf2b2b51e9ad97a915: baseline-nfs-arm64 2026-03-23 18:07:12,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:07:12,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:07:12,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eaf2b2b51e9ad97a915/log.txt.gz 2026-03-23 18:07:13,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:07:13,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:07:13,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eaf2b2b51e9ad97a915/lava-logs.yaml 2026-03-23 18:07:13,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:07:13,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:07:13,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eaf2b2b51e9ad97a915/lava_callback.json.gz 2026-03-23 18:07:13,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:13,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eaf2b2b51e9ad97a915 HTTP/1.1" 200 None 2026-03-23 18:07:13,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:13,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:07:13,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:13,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eaf2b2b51e9ad97a915 HTTP/1.1" 200 None 2026-03-23 18:07:13,566 - lava_callback - INFO - Completed processing callback for node 69c17eaf2b2b51e9ad97a915 INFO: 172.19.0.1:46024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46034 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:07:23,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:23,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:32798 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:07:36,362 - lava_callback - INFO - Received callback for node 69c181162b2b51e9ad97ab4d INFO: 172.19.0.1:51218 - "POST /node/69c181162b2b51e9ad97ab4d HTTP/1.0" 202 Accepted 2026-03-23 18:07:36,369 - lava_callback - INFO - Starting async job submit for node 69c181162b2b51e9ad97ab4d 2026-03-23 18:07:36,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c181162b2b51e9ad97ab4d HTTP/1.1" 200 None 2026-03-23 18:07:36,424 - lava_callback - DEBUG - Processing node 69c181162b2b51e9ad97ab4d: baseline-nfs-arm64 INFO: 172.19.0.1:51228 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:07:36,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:07:37,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:07:37,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c181162b2b51e9ad97ab4d/log.txt.gz 2026-03-23 18:07:37,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:07:37,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:07:37,745 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c181162b2b51e9ad97ab4d/lava-logs.yaml 2026-03-23 18:07:37,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:07:37,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:07:37,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c181162b2b51e9ad97ab4d/lava_callback.json.gz 2026-03-23 18:07:37,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:37,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c181162b2b51e9ad97ab4d HTTP/1.1" 200 None 2026-03-23 18:07:37,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:38,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:07:38,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:38,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c181162b2b51e9ad97ab4d HTTP/1.1" 200 None 2026-03-23 18:07:38,037 - lava_callback - INFO - Completed processing callback for node 69c181162b2b51e9ad97ab4d INFO: 172.19.0.1:49656 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:07:53,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:07:53,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33750 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:08:52,267 - lava_callback - INFO - Received callback for node 69c1817e2b2b51e9ad97ab6e INFO: 172.19.0.1:40690 - "POST /node/69c1817e2b2b51e9ad97ab6e HTTP/1.0" 202 Accepted 2026-03-23 18:08:52,273 - lava_callback - INFO - Starting async job submit for node 69c1817e2b2b51e9ad97ab6e 2026-03-23 18:08:52,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:08:52,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1817e2b2b51e9ad97ab6e HTTP/1.1" 200 None 2026-03-23 18:08:52,310 - lava_callback - DEBUG - Processing node 69c1817e2b2b51e9ad97ab6e: baseline-arm64-pengutronix 2026-03-23 18:08:52,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:08:52,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:08:52,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c1817e2b2b51e9ad97ab6e/log.txt.gz 2026-03-23 18:08:52,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:08:53,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:08:53,006 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c1817e2b2b51e9ad97ab6e/lava-logs.yaml 2026-03-23 18:08:53,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:08:53,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:08:53,172 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69c1817e2b2b51e9ad97ab6e/lava_callback.json.gz 2026-03-23 18:08:53,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:08:53,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1817e2b2b51e9ad97ab6e HTTP/1.1" 200 None 2026-03-23 18:08:53,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:08:53,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:08:53,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:08:53,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1817e2b2b51e9ad97ab6e HTTP/1.1" 200 None 2026-03-23 18:08:53,267 - lava_callback - INFO - Completed processing callback for node 69c1817e2b2b51e9ad97ab6e 2026-03-23 18:08:53,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:08:53,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48630 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:10:35,298 - lava_callback - INFO - Received callback for node 69c17ea22b2b51e9ad97a8f7 INFO: 172.19.0.1:40364 - "POST /node/69c17ea22b2b51e9ad97a8f7 HTTP/1.0" 202 Accepted 2026-03-23 18:10:35,305 - lava_callback - INFO - Starting async job submit for node 69c17ea22b2b51e9ad97a8f7 2026-03-23 18:10:35,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:10:35,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea22b2b51e9ad97a8f7 HTTP/1.1" 200 None 2026-03-23 18:10:35,368 - lava_callback - DEBUG - Processing node 69c17ea22b2b51e9ad97a8f7: baseline-arm64 2026-03-23 18:10:36,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:10:36,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:10:36,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea22b2b51e9ad97a8f7/log.txt.gz INFO: 172.19.0.1:40378 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:10:36,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:10:37,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:10:37,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea22b2b51e9ad97a8f7/lava-logs.yaml 2026-03-23 18:10:37,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:10:37,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:10:37,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c17ea22b2b51e9ad97a8f7/lava_callback.json.gz DEBUG: Setup failed for 69c17ea22b2b51e9ad97a8f7. Transitting job node result: incomplete -> fail 2026-03-23 18:10:37,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:10:37,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea22b2b51e9ad97a8f7 HTTP/1.1" 200 None 2026-03-23 18:10:37,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:10:37,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:10:37,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:10:37,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea22b2b51e9ad97a8f7 HTTP/1.1" 200 None 2026-03-23 18:10:37,546 - lava_callback - INFO - Completed processing callback for node 69c17ea22b2b51e9ad97a8f7 INFO: 172.19.0.1:44626 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:10:53,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:10:53,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51812 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:11:07,758 - lava_callback - INFO - Received callback for node 69c17eb32b2b51e9ad97a91e INFO: 172.19.0.1:51822 - "POST /node/69c17eb32b2b51e9ad97a91e HTTP/1.0" 202 Accepted 2026-03-23 18:11:07,766 - lava_callback - INFO - Starting async job submit for node 69c17eb32b2b51e9ad97a91e 2026-03-23 18:11:07,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:11:07,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb32b2b51e9ad97a91e HTTP/1.1" 200 None 2026-03-23 18:11:07,832 - lava_callback - DEBUG - Processing node 69c17eb32b2b51e9ad97a91e: baseline-nfs-arm64 2026-03-23 18:11:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:11:08,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:11:08,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb32b2b51e9ad97a91e/log.txt.gz 2026-03-23 18:11:09,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:11:09,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:11:09,394 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb32b2b51e9ad97a91e/lava-logs.yaml 2026-03-23 18:11:09,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:11:09,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:11:09,573 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17eb32b2b51e9ad97a91e/lava_callback.json.gz DEBUG: Setup failed for 69c17eb32b2b51e9ad97a91e. Transitting job node result: incomplete -> fail 2026-03-23 18:11:09,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:11:09,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17eb32b2b51e9ad97a91e HTTP/1.1" 200 None 2026-03-23 18:11:09,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:11:09,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:11:09,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:11:09,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17eb32b2b51e9ad97a91e HTTP/1.1" 200 None 2026-03-23 18:11:09,865 - lava_callback - INFO - Completed processing callback for node 69c17eb32b2b51e9ad97a91e INFO: 172.19.0.1:43652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43656 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:11:23,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:11:23,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46214 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:13:39,014 - lava_callback - INFO - Received callback for node 69c182912b2b51e9ad97aba7 INFO: 172.19.0.1:46216 - "POST /node/69c182912b2b51e9ad97aba7 HTTP/1.0" 202 Accepted 2026-03-23 18:13:39,021 - lava_callback - INFO - Starting async job submit for node 69c182912b2b51e9ad97aba7 2026-03-23 18:13:39,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:13:39,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182912b2b51e9ad97aba7 HTTP/1.1" 200 None 2026-03-23 18:13:39,067 - lava_callback - DEBUG - Processing node 69c182912b2b51e9ad97aba7: baseline-arm64 2026-03-23 18:13:39,202 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:13:39,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:13:39,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:13:39,474 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c182912b2b51e9ad97aba7/lava-logs.yaml 2026-03-23 18:13:39,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:13:39,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:13:39,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c182912b2b51e9ad97aba7/lava_callback.json.gz 2026-03-23 18:13:39,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:13:39,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182912b2b51e9ad97aba7 HTTP/1.1" 200 None 2026-03-23 18:13:39,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:13:39,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:13:39,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:13:39,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c182912b2b51e9ad97aba7 HTTP/1.1" 200 None 2026-03-23 18:13:39,773 - lava_callback - INFO - Completed processing callback for node 69c182912b2b51e9ad97aba7 INFO: 172.19.0.1:49356 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:13:53,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:13:53,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50580 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:14:55,151 - lava_callback - INFO - Received callback for node 69c17c362b2b51e9ad97a7fa INFO: 172.19.0.1:59028 - "POST /node/69c17c362b2b51e9ad97a7fa HTTP/1.0" 202 Accepted 2026-03-23 18:14:55,158 - lava_callback - INFO - Starting async job submit for node 69c17c362b2b51e9ad97a7fa 2026-03-23 18:14:55,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:14:55,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17c362b2b51e9ad97a7fa HTTP/1.1" 200 None 2026-03-23 18:14:55,230 - lava_callback - DEBUG - Processing node 69c17c362b2b51e9ad97a7fa: ltp-smoke 2026-03-23 18:14:55,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:14:55,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:14:55,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c17c362b2b51e9ad97a7fa/log.txt.gz 2026-03-23 18:14:56,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:14:56,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:14:56,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c17c362b2b51e9ad97a7fa/lava-logs.yaml 2026-03-23 18:14:56,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:59030 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:14:56,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:14:56,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c17c362b2b51e9ad97a7fa/lava_callback.json.gz 2026-03-23 18:14:56,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:14:56,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17c362b2b51e9ad97a7fa HTTP/1.1" 200 None 2026-03-23 18:14:56,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:14:56,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1678e2b2b51e9ad97794c HTTP/1.1" 200 None 2026-03-23 18:14:56,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:14:56,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17c362b2b51e9ad97a7fa HTTP/1.1" 200 None 2026-03-23 18:14:56,953 - lava_callback - INFO - Completed processing callback for node 69c17c362b2b51e9ad97a7fa INFO: 172.19.0.1:41514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37150 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:15:23,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:23,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51412 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:15:53,769 - lava_callback - INFO - Received callback for node 69c17ea92b2b51e9ad97a906 INFO: 172.19.0.1:42648 - "POST /node/69c17ea92b2b51e9ad97a906 HTTP/1.0" 202 Accepted 2026-03-23 18:15:53,778 - lava_callback - INFO - Starting async job submit for node 69c17ea92b2b51e9ad97a906 2026-03-23 18:15:53,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:53,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea92b2b51e9ad97a906 HTTP/1.1" 200 None 2026-03-23 18:15:53,850 - lava_callback - DEBUG - Processing node 69c17ea92b2b51e9ad97a906: baseline-nfs-arm64 2026-03-23 18:15:54,709 - lava_callback - INFO - Received callback for node 69c17ec72b2b51e9ad97a965 INFO: 172.19.0.1:42662 - "POST /node/69c17ec72b2b51e9ad97a965 HTTP/1.0" 202 Accepted 2026-03-23 18:15:54,726 - lava_callback - INFO - Starting async job submit for node 69c17ec72b2b51e9ad97a965 2026-03-23 18:15:54,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:54,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ec72b2b51e9ad97a965 HTTP/1.1" 200 None 2026-03-23 18:15:54,885 - lava_callback - DEBUG - Processing node 69c17ec72b2b51e9ad97a965: baseline-arm64-broonie 2026-03-23 18:15:55,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:15:55,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:15:55,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:15:55,472 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec72b2b51e9ad97a965/log.txt.gz 2026-03-23 18:15:55,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:15:55,549 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea92b2b51e9ad97a906/log.txt.gz 2026-03-23 18:15:55,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:15:55,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:15:56,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec72b2b51e9ad97a965/lava-logs.yaml 2026-03-23 18:15:56,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:15:56,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:15:56,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec72b2b51e9ad97a965/lava_callback.json.gz 2026-03-23 18:15:56,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:15:56,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:56,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ec72b2b51e9ad97a965 HTTP/1.1" 200 None 2026-03-23 18:15:56,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:56,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:15:56,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:56,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ec72b2b51e9ad97a965 HTTP/1.1" 200 None 2026-03-23 18:15:56,404 - lava_callback - INFO - Completed processing callback for node 69c17ec72b2b51e9ad97a965 INFO: 172.19.0.1:42670 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:15:56,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:15:56,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea92b2b51e9ad97a906/lava-logs.yaml 2026-03-23 18:15:56,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:15:56,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:15:56,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c17ea92b2b51e9ad97a906/lava_callback.json.gz DEBUG: Setup failed for 69c17ea92b2b51e9ad97a906. Transitting job node result: incomplete -> fail 2026-03-23 18:15:57,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:57,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ea92b2b51e9ad97a906 HTTP/1.1" 200 None 2026-03-23 18:15:57,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:57,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:15:57,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:15:57,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ea92b2b51e9ad97a906 HTTP/1.1" 200 None 2026-03-23 18:15:57,182 - lava_callback - INFO - Completed processing callback for node 69c17ea92b2b51e9ad97a906 INFO: 172.19.0.1:47346 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:16:03,977 - lava_callback - INFO - Received callback for node 69c183462b2b51e9ad97abd0 INFO: 172.19.0.1:47354 - "POST /node/69c183462b2b51e9ad97abd0 HTTP/1.0" 202 Accepted 2026-03-23 18:16:03,983 - lava_callback - INFO - Starting async job submit for node 69c183462b2b51e9ad97abd0 2026-03-23 18:16:03,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:16:03,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c183462b2b51e9ad97abd0 HTTP/1.1" 200 None 2026-03-23 18:16:04,000 - lava_callback - DEBUG - Processing node 69c183462b2b51e9ad97abd0: baseline-nfs-arm64 2026-03-23 18:16:04,002 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:16:04,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:16:04,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:16:04,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c183462b2b51e9ad97abd0/lava-logs.yaml 2026-03-23 18:16:04,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:16:04,273 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:16:04,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c183462b2b51e9ad97abd0/lava_callback.json.gz 2026-03-23 18:16:04,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:16:04,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c183462b2b51e9ad97abd0 HTTP/1.1" 200 None 2026-03-23 18:16:04,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:16:04,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:16:04,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:16:04,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c183462b2b51e9ad97abd0 HTTP/1.1" 200 None 2026-03-23 18:16:04,353 - lava_callback - INFO - Completed processing callback for node 69c183462b2b51e9ad97abd0 INFO: 172.19.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54924 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:16:23,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:16:23,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43964 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 18:17:15,780 - lava_callback - INFO - Received callback for node 69c17ed32b2b51e9ad97a988 INFO: 172.19.0.1:43972 - "POST /node/69c17ed32b2b51e9ad97a988 HTTP/1.0" 202 Accepted 2026-03-23 18:17:15,788 - lava_callback - INFO - Starting async job submit for node 69c17ed32b2b51e9ad97a988 2026-03-23 18:17:15,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:15,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed32b2b51e9ad97a988 HTTP/1.1" 200 None 2026-03-23 18:17:15,864 - lava_callback - DEBUG - Processing node 69c17ed32b2b51e9ad97a988: baseline-arm64-clabbe 2026-03-23 18:17:16,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:43982 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:17:16,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:17:16,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c17ed32b2b51e9ad97a988/log.txt.gz 2026-03-23 18:17:16,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:17:17,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:17:17,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c17ed32b2b51e9ad97a988/lava-logs.yaml 2026-03-23 18:17:17,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:17:17,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:17:17,430 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c17ed32b2b51e9ad97a988/lava_callback.json.gz DEBUG: Setup failed for 69c17ed32b2b51e9ad97a988. Transitting job node result: incomplete -> fail 2026-03-23 18:17:17,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:17,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ed32b2b51e9ad97a988 HTTP/1.1" 200 None 2026-03-23 18:17:17,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:17,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:17:17,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:17,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ed32b2b51e9ad97a988 HTTP/1.1" 200 None 2026-03-23 18:17:17,698 - lava_callback - INFO - Completed processing callback for node 69c17ed32b2b51e9ad97a988 2026-03-23 18:17:23,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:23,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54376 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:17:35,947 - lava_callback - INFO - Received callback for node 69c182112b2b51e9ad97ab84 INFO: 172.19.0.1:36384 - "POST /node/69c182112b2b51e9ad97ab84 HTTP/1.0" 202 Accepted 2026-03-23 18:17:35,954 - lava_callback - INFO - Starting async job submit for node 69c182112b2b51e9ad97ab84 2026-03-23 18:17:35,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:36,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182112b2b51e9ad97ab84 HTTP/1.1" 200 None 2026-03-23 18:17:36,007 - lava_callback - DEBUG - Processing node 69c182112b2b51e9ad97ab84: baseline-arm64 2026-03-23 18:17:36,214 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:17:36,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:36390 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:17:36,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:17:36,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c182112b2b51e9ad97ab84/lava-logs.yaml 2026-03-23 18:17:36,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:17:36,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:17:36,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c182112b2b51e9ad97ab84/lava_callback.json.gz 2026-03-23 18:17:36,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:36,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182112b2b51e9ad97ab84 HTTP/1.1" 200 None 2026-03-23 18:17:36,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:36,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:17:36,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:36,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c182112b2b51e9ad97ab84 HTTP/1.1" 200 None 2026-03-23 18:17:36,794 - lava_callback - INFO - Completed processing callback for node 69c182112b2b51e9ad97ab84 INFO: 172.19.0.1:53260 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:17:53,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:17:53,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:50900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49094 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:22:20,605 - lava_callback - INFO - Received callback for node 69c182ea2b2b51e9ad97abb1 INFO: 172.19.0.1:60252 - "POST /node/69c182ea2b2b51e9ad97abb1 HTTP/1.0" 202 Accepted 2026-03-23 18:22:20,612 - lava_callback - INFO - Starting async job submit for node 69c182ea2b2b51e9ad97abb1 2026-03-23 18:22:20,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:22:20,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182ea2b2b51e9ad97abb1 HTTP/1.1" 200 None 2026-03-23 18:22:20,663 - lava_callback - DEBUG - Processing node 69c182ea2b2b51e9ad97abb1: baseline-arm64 2026-03-23 18:22:21,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:22:21,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:22:21,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c182ea2b2b51e9ad97abb1/log.txt.gz 2026-03-23 18:22:21,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:22:21,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:22:21,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c182ea2b2b51e9ad97abb1/lava-logs.yaml 2026-03-23 18:22:21,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:22:21,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:22:21,823 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c182ea2b2b51e9ad97abb1/lava_callback.json.gz DEBUG: Setup failed for 69c182ea2b2b51e9ad97abb1. Transitting job node result: incomplete -> fail 2026-03-23 18:22:21,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:22:21,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182ea2b2b51e9ad97abb1 HTTP/1.1" 200 None 2026-03-23 18:22:21,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:22:21,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:22:21,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:22:21,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c182ea2b2b51e9ad97abb1 HTTP/1.1" 200 None 2026-03-23 18:22:22,057 - lava_callback - INFO - Completed processing callback for node 69c182ea2b2b51e9ad97abb1 2026-03-23 18:22:23,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:22:23,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36772 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:24:02,532 - lava_callback - INFO - Received callback for node 69c184e92b2b51e9ad97ac4b INFO: 172.19.0.1:49756 - "POST /node/69c184e92b2b51e9ad97ac4b HTTP/1.0" 202 Accepted 2026-03-23 18:24:02,538 - lava_callback - INFO - Starting async job submit for node 69c184e92b2b51e9ad97ac4b 2026-03-23 18:24:02,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:24:02,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c184e92b2b51e9ad97ac4b HTTP/1.1" 200 None 2026-03-23 18:24:02,584 - lava_callback - DEBUG - Processing node 69c184e92b2b51e9ad97ac4b: baseline-arm64 2026-03-23 18:24:02,721 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:24:02,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:24:03,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:24:03,003 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c184e92b2b51e9ad97ac4b/lava-logs.yaml 2026-03-23 18:24:03,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:24:03,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:24:03,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c184e92b2b51e9ad97ac4b/lava_callback.json.gz INFO: 172.19.0.1:49766 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:24:03,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:24:03,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c184e92b2b51e9ad97ac4b HTTP/1.1" 200 None 2026-03-23 18:24:03,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:24:03,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:24:03,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:24:03,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c184e92b2b51e9ad97ac4b HTTP/1.1" 200 None 2026-03-23 18:24:03,309 - lava_callback - INFO - Completed processing callback for node 69c184e92b2b51e9ad97ac4b INFO: 172.19.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54650 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:24:23,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:24:23,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46122 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:27:14,757 - lava_callback - INFO - Received callback for node 69c183932b2b51e9ad97abfc INFO: 172.19.0.1:35598 - "POST /node/69c183932b2b51e9ad97abfc HTTP/1.0" 202 Accepted 2026-03-23 18:27:14,763 - lava_callback - INFO - Starting async job submit for node 69c183932b2b51e9ad97abfc 2026-03-23 18:27:14,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:14,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c183932b2b51e9ad97abfc HTTP/1.1" 200 None 2026-03-23 18:27:14,803 - lava_callback - DEBUG - Processing node 69c183932b2b51e9ad97abfc: baseline-arm64 INFO: 172.19.0.1:35602 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 18:27:15,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:27:15,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:27:15,440 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c183932b2b51e9ad97abfc/log.txt.gz 2026-03-23 18:27:15,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:27:15,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:27:15,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c183932b2b51e9ad97abfc/lava-logs.yaml 2026-03-23 18:27:15,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:27:16,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:27:16,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c183932b2b51e9ad97abfc/lava_callback.json.gz 2026-03-23 18:27:16,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:16,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c183932b2b51e9ad97abfc HTTP/1.1" 200 None 2026-03-23 18:27:16,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:16,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:27:16,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:16,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c183932b2b51e9ad97abfc HTTP/1.1" 200 None 2026-03-23 18:27:16,270 - lava_callback - INFO - Completed processing callback for node 69c183932b2b51e9ad97abfc INFO: 172.19.0.1:35610 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:27:23,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:23,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48584 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:27:52,694 - lava_callback - INFO - Received callback for node 69c185f92b2b51e9ad97ac78 INFO: 172.19.0.1:41946 - "POST /node/69c185f92b2b51e9ad97ac78 HTTP/1.0" 202 Accepted 2026-03-23 18:27:52,701 - lava_callback - INFO - Starting async job submit for node 69c185f92b2b51e9ad97ac78 2026-03-23 18:27:52,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:52,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c185f92b2b51e9ad97ac78 HTTP/1.1" 200 None 2026-03-23 18:27:52,749 - lava_callback - DEBUG - Processing node 69c185f92b2b51e9ad97ac78: baseline-arm64 2026-03-23 18:27:52,892 - lava_callback - WARNING - Failed to upload log 2026-03-23 18:27:52,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:27:53,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:27:53,109 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c185f92b2b51e9ad97ac78/lava-logs.yaml 2026-03-23 18:27:53,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:27:53,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:27:53,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c185f92b2b51e9ad97ac78/lava_callback.json.gz 2026-03-23 18:27:53,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:53,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c185f92b2b51e9ad97ac78 HTTP/1.1" 200 None 2026-03-23 18:27:53,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:53,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:27:53,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:53,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c185f92b2b51e9ad97ac78 HTTP/1.1" 200 None 2026-03-23 18:27:53,403 - lava_callback - INFO - Completed processing callback for node 69c185f92b2b51e9ad97ac78 2026-03-23 18:27:53,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:27:53,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45874 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 18:28:15,868 - lava_callback - INFO - Received callback for node 69c182642b2b51e9ad97ab9d INFO: 172.19.0.1:45890 - "POST /node/69c182642b2b51e9ad97ab9d HTTP/1.0" 202 Accepted 2026-03-23 18:28:15,875 - lava_callback - INFO - Starting async job submit for node 69c182642b2b51e9ad97ab9d 2026-03-23 18:28:15,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:28:15,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182642b2b51e9ad97ab9d HTTP/1.1" 200 None 2026-03-23 18:28:15,943 - lava_callback - DEBUG - Processing node 69c182642b2b51e9ad97ab9d: baseline-arm INFO: 172.19.0.1:45898 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:28:16,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:28:16,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:28:16,694 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69c182642b2b51e9ad97ab9d/log.txt.gz 2026-03-23 18:28:17,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:28:17,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:28:17,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69c182642b2b51e9ad97ab9d/lava-logs.yaml 2026-03-23 18:28:17,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:28:17,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:28:17,479 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69c182642b2b51e9ad97ab9d/lava_callback.json.gz DEBUG: Setup failed for 69c182642b2b51e9ad97ab9d. Transitting job node result: incomplete -> fail 2026-03-23 18:28:17,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:28:17,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c182642b2b51e9ad97ab9d HTTP/1.1" 200 None 2026-03-23 18:28:17,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:28:17,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 18:28:17,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:28:17,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c182642b2b51e9ad97ab9d HTTP/1.1" 200 None 2026-03-23 18:28:17,762 - lava_callback - INFO - Completed processing callback for node 69c182642b2b51e9ad97ab9d 2026-03-23 18:28:23,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:28:23,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50530 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:29:02,024 - lava_callback - INFO - Received callback for node 69c183ec2b2b51e9ad97ac25 INFO: 172.19.0.1:48188 - "POST /node/69c183ec2b2b51e9ad97ac25 HTTP/1.0" 202 Accepted 2026-03-23 18:29:02,031 - lava_callback - INFO - Starting async job submit for node 69c183ec2b2b51e9ad97ac25 2026-03-23 18:29:02,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:29:02,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c183ec2b2b51e9ad97ac25 HTTP/1.1" 200 None 2026-03-23 18:29:02,093 - lava_callback - DEBUG - Processing node 69c183ec2b2b51e9ad97ac25: baseline-nfs-arm64 2026-03-23 18:29:02,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:29:02,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:29:02,749 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c183ec2b2b51e9ad97ac25/log.txt.gz 2026-03-23 18:29:03,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:29:03,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:29:03,217 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c183ec2b2b51e9ad97ac25/lava-logs.yaml 2026-03-23 18:29:03,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:48198 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:29:03,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:29:03,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c183ec2b2b51e9ad97ac25/lava_callback.json.gz 2026-03-23 18:29:03,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:29:03,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c183ec2b2b51e9ad97ac25 HTTP/1.1" 200 None 2026-03-23 18:29:03,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:29:03,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:29:03,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:29:03,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c183ec2b2b51e9ad97ac25 HTTP/1.1" 200 None 2026-03-23 18:29:03,530 - lava_callback - INFO - Completed processing callback for node 69c183ec2b2b51e9ad97ac25 INFO: 172.19.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56106 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:29:23,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:29:23,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53240 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:34:03,225 - lava_callback - INFO - Received callback for node 69c184402b2b51e9ad97ac38 INFO: 172.19.0.1:34530 - "POST /node/69c184402b2b51e9ad97ac38 HTTP/1.0" 202 Accepted 2026-03-23 18:34:03,232 - lava_callback - INFO - Starting async job submit for node 69c184402b2b51e9ad97ac38 2026-03-23 18:34:03,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:03,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c184402b2b51e9ad97ac38 HTTP/1.1" 200 None 2026-03-23 18:34:03,322 - lava_callback - DEBUG - Processing node 69c184402b2b51e9ad97ac38: baseline-arm64 INFO: 172.19.0.1:34546 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:34:04,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:34:04,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:34:04,195 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c184402b2b51e9ad97ac38/log.txt.gz 2026-03-23 18:34:04,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:34:04,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:34:04,939 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c184402b2b51e9ad97ac38/lava-logs.yaml 2026-03-23 18:34:04,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:34:05,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:34:05,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c184402b2b51e9ad97ac38/lava_callback.json.gz DEBUG: Setup failed for 69c184402b2b51e9ad97ac38. Transitting job node result: incomplete -> fail 2026-03-23 18:34:05,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:05,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c184402b2b51e9ad97ac38 HTTP/1.1" 200 None 2026-03-23 18:34:05,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:05,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:34:05,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:05,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c184402b2b51e9ad97ac38 HTTP/1.1" 200 None 2026-03-23 18:34:05,365 - lava_callback - INFO - Completed processing callback for node 69c184402b2b51e9ad97ac38 INFO: 172.19.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44488 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:34:23,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:23,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39384 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:34:33,866 - lava_callback - INFO - Received callback for node 69c185b62b2b51e9ad97ac6f INFO: 172.19.0.1:42644 - "POST /node/69c185b62b2b51e9ad97ac6f HTTP/1.0" 202 Accepted 2026-03-23 18:34:33,873 - lava_callback - INFO - Starting async job submit for node 69c185b62b2b51e9ad97ac6f 2026-03-23 18:34:33,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:33,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c185b62b2b51e9ad97ac6f HTTP/1.1" 200 None 2026-03-23 18:34:33,921 - lava_callback - DEBUG - Processing node 69c185b62b2b51e9ad97ac6f: baseline-arm64-clabbe 2026-03-23 18:34:34,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:34:34,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:34:34,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c185b62b2b51e9ad97ac6f/log.txt.gz 2026-03-23 18:34:34,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:34:34,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:34:34,959 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c185b62b2b51e9ad97ac6f/lava-logs.yaml 2026-03-23 18:34:34,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:34:35,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:34:35,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69c185b62b2b51e9ad97ac6f/lava_callback.json.gz 2026-03-23 18:34:35,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:35,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c185b62b2b51e9ad97ac6f HTTP/1.1" 200 None 2026-03-23 18:34:35,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:35,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:34:35,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:35,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c185b62b2b51e9ad97ac6f HTTP/1.1" 200 None 2026-03-23 18:34:35,241 - lava_callback - INFO - Completed processing callback for node 69c185b62b2b51e9ad97ac6f INFO: 172.19.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36870 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:34:53,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:34:53,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44468 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:35:47,294 - lava_callback - INFO - Received callback for node 69c1849d2b2b51e9ad97ac40 INFO: 172.19.0.1:44470 - "POST /node/69c1849d2b2b51e9ad97ac40 HTTP/1.0" 202 Accepted 2026-03-23 18:35:47,301 - lava_callback - INFO - Starting async job submit for node 69c1849d2b2b51e9ad97ac40 2026-03-23 18:35:47,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:35:47,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1849d2b2b51e9ad97ac40 HTTP/1.1" 200 None 2026-03-23 18:35:47,367 - lava_callback - DEBUG - Processing node 69c1849d2b2b51e9ad97ac40: baseline-nfs-arm64 2026-03-23 18:35:48,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:35:48,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:35:48,253 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1849d2b2b51e9ad97ac40/log.txt.gz 2026-03-23 18:35:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:35:48,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:35:48,921 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1849d2b2b51e9ad97ac40/lava-logs.yaml 2026-03-23 18:35:48,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:35:49,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:35:49,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1849d2b2b51e9ad97ac40/lava_callback.json.gz DEBUG: Setup failed for 69c1849d2b2b51e9ad97ac40. Transitting job node result: incomplete -> fail 2026-03-23 18:35:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:35:49,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1849d2b2b51e9ad97ac40 HTTP/1.1" 200 None 2026-03-23 18:35:49,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:35:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:35:49,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:35:49,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1849d2b2b51e9ad97ac40 HTTP/1.1" 200 None 2026-03-23 18:35:49,410 - lava_callback - INFO - Completed processing callback for node 69c1849d2b2b51e9ad97ac40 2026-03-23 18:35:53,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:35:53,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47350 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:36:18,171 - lava_callback - INFO - Received callback for node 69c186552b2b51e9ad97ac8c INFO: 172.19.0.1:47360 - "POST /node/69c186552b2b51e9ad97ac8c HTTP/1.0" 202 Accepted 2026-03-23 18:36:18,178 - lava_callback - INFO - Starting async job submit for node 69c186552b2b51e9ad97ac8c 2026-03-23 18:36:18,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:36:18,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c186552b2b51e9ad97ac8c HTTP/1.1" 200 None 2026-03-23 18:36:18,231 - lava_callback - DEBUG - Processing node 69c186552b2b51e9ad97ac8c: baseline-arm64 2026-03-23 18:36:18,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:36:18,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:36:18,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c186552b2b51e9ad97ac8c/log.txt.gz 2026-03-23 18:36:18,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:36:19,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:36:19,174 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c186552b2b51e9ad97ac8c/lava-logs.yaml 2026-03-23 18:36:19,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:36:19,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:36:19,326 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c186552b2b51e9ad97ac8c/lava_callback.json.gz DEBUG: Setup failed for 69c186552b2b51e9ad97ac8c. Transitting job node result: incomplete -> fail 2026-03-23 18:36:19,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:36:19,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c186552b2b51e9ad97ac8c HTTP/1.1" 200 None 2026-03-23 18:36:19,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:36:19,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:36:19,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:36:19,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c186552b2b51e9ad97ac8c HTTP/1.1" 200 None 2026-03-23 18:36:19,549 - lava_callback - INFO - Completed processing callback for node 69c186552b2b51e9ad97ac8c 2026-03-23 18:36:23,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:36:23,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43620 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:41:59,701 - lava_callback - INFO - Received callback for node 69c185432b2b51e9ad97ac55 INFO: 172.19.0.1:55324 - "POST /node/69c185432b2b51e9ad97ac55 HTTP/1.0" 202 Accepted 2026-03-23 18:41:59,708 - lava_callback - INFO - Starting async job submit for node 69c185432b2b51e9ad97ac55 2026-03-23 18:41:59,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:41:59,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c185432b2b51e9ad97ac55 HTTP/1.1" 200 None 2026-03-23 18:41:59,813 - lava_callback - DEBUG - Processing node 69c185432b2b51e9ad97ac55: ltp-smoke 2026-03-23 18:42:00,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:42:00,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:42:00,450 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69c185432b2b51e9ad97ac55/log.txt.gz 2026-03-23 18:42:00,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:42:00,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:42:00,964 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69c185432b2b51e9ad97ac55/lava-logs.yaml 2026-03-23 18:42:00,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:42:01,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:42:01,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69c185432b2b51e9ad97ac55/lava_callback.json.gz 2026-03-23 18:42:01,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:42:01,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c185432b2b51e9ad97ac55 HTTP/1.1" 200 None 2026-03-23 18:42:01,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:42:01,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1678e2b2b51e9ad97794c HTTP/1.1" 200 None 2026-03-23 18:42:01,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:42:01,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c185432b2b51e9ad97ac55 HTTP/1.1" 200 None 2026-03-23 18:42:01,466 - lava_callback - INFO - Completed processing callback for node 69c185432b2b51e9ad97ac55 INFO: 172.19.0.1:55334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35876 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:42:23,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:42:23,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57624 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:43:23,264 - lava_callback - INFO - Received callback for node 69c17c172b2b51e9ad97a7e8 INFO: 172.19.0.1:60740 - "POST /node/69c17c172b2b51e9ad97a7e8 HTTP/1.0" 202 Accepted 2026-03-23 18:43:23,313 - lava_callback - INFO - Starting async job submit for node 69c17c172b2b51e9ad97a7e8 2026-03-23 18:43:23,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:23,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17c172b2b51e9ad97a7e8 HTTP/1.1" 200 None 2026-03-23 18:43:23,352 - lava_callback - DEBUG - Processing node 69c17c172b2b51e9ad97a7e8: baseline-arm-pengutronix 2026-03-23 18:43:23,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:43:23,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:43:23,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c17c172b2b51e9ad97a7e8/log.txt.gz 2026-03-23 18:43:23,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:43:23,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:43:23,829 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c17c172b2b51e9ad97a7e8/lava-logs.yaml 2026-03-23 18:43:23,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:43:23,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:43:23,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c17c172b2b51e9ad97a7e8/lava_callback.json.gz DEBUG: Setup failed for 69c17c172b2b51e9ad97a7e8. Transitting job node result: incomplete -> fail 2026-03-23 18:43:23,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:24,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17c172b2b51e9ad97a7e8 HTTP/1.1" 200 None 2026-03-23 18:43:24,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:24,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 18:43:24,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:24,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17c172b2b51e9ad97a7e8 HTTP/1.1" 200 None 2026-03-23 18:43:24,119 - lava_callback - INFO - Completed processing callback for node 69c17c172b2b51e9ad97a7e8 INFO: 172.19.0.1:60752 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:43:26,842 - lava_callback - INFO - Received callback for node 69c1886c2b2b51e9ad97ad54 INFO: 172.19.0.1:60766 - "POST /node/69c1886c2b2b51e9ad97ad54 HTTP/1.0" 202 Accepted 2026-03-23 18:43:26,849 - lava_callback - INFO - Starting async job submit for node 69c1886c2b2b51e9ad97ad54 2026-03-23 18:43:26,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:26,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1886c2b2b51e9ad97ad54 HTTP/1.1" 200 None 2026-03-23 18:43:26,907 - lava_callback - DEBUG - Processing node 69c1886c2b2b51e9ad97ad54: baseline-arm64 2026-03-23 18:43:27,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:43:27,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:43:27,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1886c2b2b51e9ad97ad54/log.txt.gz 2026-03-23 18:43:27,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:43:27,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:43:27,892 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1886c2b2b51e9ad97ad54/lava-logs.yaml 2026-03-23 18:43:27,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:43:28,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:43:28,046 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1886c2b2b51e9ad97ad54/lava_callback.json.gz DEBUG: Setup failed for 69c1886c2b2b51e9ad97ad54. Transitting job node result: incomplete -> fail 2026-03-23 18:43:28,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:28,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1886c2b2b51e9ad97ad54 HTTP/1.1" 200 None 2026-03-23 18:43:28,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:28,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:43:28,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:28,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1886c2b2b51e9ad97ad54 HTTP/1.1" 200 None 2026-03-23 18:43:28,266 - lava_callback - INFO - Completed processing callback for node 69c1886c2b2b51e9ad97ad54 INFO: 172.19.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36780 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:43:53,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:43:53,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54436 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:44:19,682 - lava_callback - INFO - Received callback for node 69bee6eea85a0f2cbb32d843 INFO: 172.19.0.1:54450 - "POST /node/69bee6eea85a0f2cbb32d843 HTTP/1.0" 202 Accepted 2026-03-23 18:44:19,688 - lava_callback - INFO - Starting async job submit for node 69bee6eea85a0f2cbb32d843 2026-03-23 18:44:19,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:19,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee6eea85a0f2cbb32d843 HTTP/1.1" 200 None 2026-03-23 18:44:19,709 - lava_callback - DEBUG - Processing node 69bee6eea85a0f2cbb32d843: baseline-arm-clabbe 2026-03-23 18:44:19,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bee6eea85a0f2cbb32d843 2026-03-23 18:44:19,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:19,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee6eea85a0f2cbb32d843 HTTP/1.1" 200 None 2026-03-23 18:44:19,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:19,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 18:44:19,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:19,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bee6eea85a0f2cbb32d843 HTTP/1.1" 200 None 2026-03-23 18:44:19,812 - lava_callback - ERROR - Error processing callback for node 69bee6eea85a0f2cbb32d843: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46532 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:44:39,663 - lava_callback - INFO - Received callback for node 69bee714a85a0f2cbb32d854 INFO: 172.19.0.1:46536 - "POST /node/69bee714a85a0f2cbb32d854 HTTP/1.0" 202 Accepted 2026-03-23 18:44:39,669 - lava_callback - INFO - Starting async job submit for node 69bee714a85a0f2cbb32d854 2026-03-23 18:44:39,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:39,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee714a85a0f2cbb32d854 HTTP/1.1" 200 None 2026-03-23 18:44:39,685 - lava_callback - DEBUG - Processing node 69bee714a85a0f2cbb32d854: baseline-arm-clabbe 2026-03-23 18:44:39,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bee714a85a0f2cbb32d854 2026-03-23 18:44:39,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:39,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee714a85a0f2cbb32d854 HTTP/1.1" 200 None 2026-03-23 18:44:39,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:39,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 18:44:39,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:44:39,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bee714a85a0f2cbb32d854 HTTP/1.1" 200 None 2026-03-23 18:44:39,739 - lava_callback - ERROR - Error processing callback for node 69bee714a85a0f2cbb32d854: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41588 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:45:19,710 - lava_callback - INFO - Received callback for node 69bee738a85a0f2cbb32d865 INFO: 172.19.0.1:53554 - "POST /node/69bee738a85a0f2cbb32d865 HTTP/1.0" 202 Accepted 2026-03-23 18:45:19,715 - lava_callback - INFO - Starting async job submit for node 69bee738a85a0f2cbb32d865 2026-03-23 18:45:19,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:45:19,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee738a85a0f2cbb32d865 HTTP/1.1" 200 None 2026-03-23 18:45:19,754 - lava_callback - DEBUG - Processing node 69bee738a85a0f2cbb32d865: baseline-arm-clabbe 2026-03-23 18:45:19,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bee738a85a0f2cbb32d865 2026-03-23 18:45:19,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:45:19,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee738a85a0f2cbb32d865 HTTP/1.1" 200 None 2026-03-23 18:45:19,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:45:19,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 18:45:19,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:45:19,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bee738a85a0f2cbb32d865 HTTP/1.1" 200 None 2026-03-23 18:45:19,812 - lava_callback - ERROR - Error processing callback for node 69bee738a85a0f2cbb32d865: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60290 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:46:19,767 - lava_callback - INFO - Received callback for node 69bee767a85a0f2cbb32d877 INFO: 172.19.0.1:49848 - "POST /node/69bee767a85a0f2cbb32d877 HTTP/1.0" 202 Accepted 2026-03-23 18:46:19,773 - lava_callback - INFO - Starting async job submit for node 69bee767a85a0f2cbb32d877 2026-03-23 18:46:19,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:19,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee767a85a0f2cbb32d877 HTTP/1.1" 200 None 2026-03-23 18:46:19,789 - lava_callback - DEBUG - Processing node 69bee767a85a0f2cbb32d877: baseline-arm-clabbe 2026-03-23 18:46:19,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bee767a85a0f2cbb32d877 2026-03-23 18:46:19,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:19,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee767a85a0f2cbb32d877 HTTP/1.1" 200 None 2026-03-23 18:46:19,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:19,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 18:46:19,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:19,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bee767a85a0f2cbb32d877 HTTP/1.1" 200 None 2026-03-23 18:46:19,848 - lava_callback - ERROR - Error processing callback for node 69bee767a85a0f2cbb32d877: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47650 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:46:39,721 - lava_callback - INFO - Received callback for node 69bee78ba85a0f2cbb32d887 INFO: 172.19.0.1:57400 - "POST /node/69bee78ba85a0f2cbb32d887 HTTP/1.0" 202 Accepted 2026-03-23 18:46:39,726 - lava_callback - INFO - Starting async job submit for node 69bee78ba85a0f2cbb32d887 2026-03-23 18:46:39,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:39,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee78ba85a0f2cbb32d887 HTTP/1.1" 200 None 2026-03-23 18:46:39,743 - lava_callback - DEBUG - Processing node 69bee78ba85a0f2cbb32d887: baseline-arm-clabbe 2026-03-23 18:46:39,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bee78ba85a0f2cbb32d887 2026-03-23 18:46:39,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:39,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bee78ba85a0f2cbb32d887 HTTP/1.1" 200 None 2026-03-23 18:46:39,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:39,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde359d54b5122738c3d93 HTTP/1.1" 200 None 2026-03-23 18:46:39,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:46:39,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bee78ba85a0f2cbb32d887 HTTP/1.1" 200 None 2026-03-23 18:46:39,793 - lava_callback - ERROR - Error processing callback for node 69bee78ba85a0f2cbb32d887: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57272 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:52:48,231 - lava_callback - INFO - Received callback for node 69c1881a2b2b51e9ad97ad14 INFO: 172.19.0.1:57276 - "POST /node/69c1881a2b2b51e9ad97ad14 HTTP/1.0" 202 Accepted 2026-03-23 18:52:48,238 - lava_callback - INFO - Starting async job submit for node 69c1881a2b2b51e9ad97ad14 2026-03-23 18:52:48,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:52:48,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1881a2b2b51e9ad97ad14 HTTP/1.1" 200 None 2026-03-23 18:52:48,303 - lava_callback - DEBUG - Processing node 69c1881a2b2b51e9ad97ad14: baseline-nfs-arm64 2026-03-23 18:52:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:52:49,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:52:49,227 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1881a2b2b51e9ad97ad14/log.txt.gz 2026-03-23 18:52:49,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:52:49,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:52:49,910 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1881a2b2b51e9ad97ad14/lava-logs.yaml 2026-03-23 18:52:49,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:52:50,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:52:50,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1881a2b2b51e9ad97ad14/lava_callback.json.gz DEBUG: Setup failed for 69c1881a2b2b51e9ad97ad14. Transitting job node result: incomplete -> fail 2026-03-23 18:52:50,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:52:50,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1881a2b2b51e9ad97ad14 HTTP/1.1" 200 None 2026-03-23 18:52:50,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:52:50,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:52:50,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:52:50,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1881a2b2b51e9ad97ad14 HTTP/1.1" 200 None 2026-03-23 18:52:50,358 - lava_callback - INFO - Completed processing callback for node 69c1881a2b2b51e9ad97ad14 2026-03-23 18:52:53,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:52:53,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46008 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:54:31,173 - lava_callback - INFO - Received callback for node 69c187bb2b2b51e9ad97ace6 INFO: 172.19.0.1:37416 - "POST /node/69c187bb2b2b51e9ad97ace6 HTTP/1.0" 202 Accepted 2026-03-23 18:54:31,180 - lava_callback - INFO - Starting async job submit for node 69c187bb2b2b51e9ad97ace6 2026-03-23 18:54:31,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:54:31,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c187bb2b2b51e9ad97ace6 HTTP/1.1" 200 None 2026-03-23 18:54:31,237 - lava_callback - DEBUG - Processing node 69c187bb2b2b51e9ad97ace6: baseline-arm64 2026-03-23 18:54:31,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:54:31,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:54:31,949 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c187bb2b2b51e9ad97ace6/log.txt.gz 2026-03-23 18:54:32,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:54:32,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:54:32,449 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c187bb2b2b51e9ad97ace6/lava-logs.yaml 2026-03-23 18:54:32,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 18:54:32,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 18:54:32,762 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c187bb2b2b51e9ad97ace6/lava_callback.json.gz DEBUG: Setup failed for 69c187bb2b2b51e9ad97ace6. Transitting job node result: incomplete -> fail 2026-03-23 18:54:32,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:54:32,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c187bb2b2b51e9ad97ace6 HTTP/1.1" 200 None 2026-03-23 18:54:32,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:54:32,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 18:54:32,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:54:32,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c187bb2b2b51e9ad97ace6 HTTP/1.1" 200 None 2026-03-23 18:54:33,036 - lava_callback - INFO - Completed processing callback for node 69c187bb2b2b51e9ad97ace6 INFO: 172.19.0.1:37424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58356 - "GET / HTTP/1.0" 200 OK 2026-03-23 18:54:53,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 18:54:53,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44398 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:03:04,186 - lava_callback - INFO - Received callback for node 69c189d92b2b51e9ad97ada8 INFO: 172.19.0.1:44402 - "POST /node/69c189d92b2b51e9ad97ada8 HTTP/1.0" 202 Accepted 2026-03-23 19:03:04,233 - lava_callback - INFO - Starting async job submit for node 69c189d92b2b51e9ad97ada8 2026-03-23 19:03:04,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:03:04,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c189d92b2b51e9ad97ada8 HTTP/1.1" 200 None 2026-03-23 19:03:04,286 - lava_callback - DEBUG - Processing node 69c189d92b2b51e9ad97ada8: baseline-arm-pengutronix 2026-03-23 19:03:04,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:03:04,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:03:04,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c189d92b2b51e9ad97ada8/log.txt.gz 2026-03-23 19:03:04,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:03:04,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:03:04,806 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c189d92b2b51e9ad97ada8/lava-logs.yaml 2026-03-23 19:03:04,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:03:04,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:03:04,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c189d92b2b51e9ad97ada8/lava_callback.json.gz DEBUG: Setup failed for 69c189d92b2b51e9ad97ada8. Transitting job node result: incomplete -> fail 2026-03-23 19:03:04,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:03:05,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c189d92b2b51e9ad97ada8 HTTP/1.1" 200 None 2026-03-23 19:03:05,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:03:05,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 19:03:05,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:03:05,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c189d92b2b51e9ad97ada8 HTTP/1.1" 200 None 2026-03-23 19:03:05,106 - lava_callback - INFO - Completed processing callback for node 69c189d92b2b51e9ad97ada8 INFO: 172.19.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33316 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:03:23,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:03:23,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46140 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:08:17,106 - lava_callback - INFO - Received callback for node 69c18c302b2b51e9ad97ae42 INFO: 172.19.0.1:46156 - "POST /node/69c18c302b2b51e9ad97ae42 HTTP/1.0" 202 Accepted 2026-03-23 19:08:17,113 - lava_callback - INFO - Starting async job submit for node 69c18c302b2b51e9ad97ae42 2026-03-23 19:08:17,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:08:17,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18c302b2b51e9ad97ae42 HTTP/1.1" 200 None 2026-03-23 19:08:17,223 - lava_callback - DEBUG - Processing node 69c18c302b2b51e9ad97ae42: baseline-nfs-arm64 2026-03-23 19:08:17,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:08:18,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:08:18,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c18c302b2b51e9ad97ae42/log.txt.gz 2026-03-23 19:08:18,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:08:18,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:08:18,955 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c18c302b2b51e9ad97ae42/lava-logs.yaml 2026-03-23 19:08:18,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:08:19,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:08:19,142 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c18c302b2b51e9ad97ae42/lava_callback.json.gz DEBUG: Setup failed for 69c18c302b2b51e9ad97ae42. Transitting job node result: incomplete -> fail 2026-03-23 19:08:19,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:08:19,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18c302b2b51e9ad97ae42 HTTP/1.1" 200 None 2026-03-23 19:08:19,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:08:19,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 19:08:19,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:08:19,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18c302b2b51e9ad97ae42 HTTP/1.1" 200 None 2026-03-23 19:08:19,419 - lava_callback - INFO - Completed processing callback for node 69c18c302b2b51e9ad97ae42 2026-03-23 19:08:23,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:08:23,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57786 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:11:47,109 - lava_callback - INFO - Received callback for node 69c18d012b2b51e9ad97ae8b INFO: 172.19.0.1:57788 - "POST /node/69c18d012b2b51e9ad97ae8b HTTP/1.0" 202 Accepted 2026-03-23 19:11:47,116 - lava_callback - INFO - Starting async job submit for node 69c18d012b2b51e9ad97ae8b 2026-03-23 19:11:47,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:11:47,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d012b2b51e9ad97ae8b HTTP/1.1" 200 None 2026-03-23 19:11:47,182 - lava_callback - DEBUG - Processing node 69c18d012b2b51e9ad97ae8b: baseline-arm64 2026-03-23 19:11:47,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:11:48,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:11:48,062 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c18d012b2b51e9ad97ae8b/log.txt.gz 2026-03-23 19:11:48,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:11:48,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:11:48,730 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c18d012b2b51e9ad97ae8b/lava-logs.yaml 2026-03-23 19:11:48,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:11:48,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:11:48,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c18d012b2b51e9ad97ae8b/lava_callback.json.gz DEBUG: Setup failed for 69c18d012b2b51e9ad97ae8b. Transitting job node result: incomplete -> fail 2026-03-23 19:11:49,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:11:49,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18d012b2b51e9ad97ae8b HTTP/1.1" 200 None 2026-03-23 19:11:49,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:11:49,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 19:11:49,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:11:49,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18d012b2b51e9ad97ae8b HTTP/1.1" 200 None 2026-03-23 19:11:49,213 - lava_callback - INFO - Completed processing callback for node 69c18d012b2b51e9ad97ae8b 2026-03-23 19:11:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:11:53,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43680 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:17:35,790 - lava_callback - INFO - Received callback for node 69beeecda85a0f2cbb32d8d6 INFO: 172.19.0.1:34892 - "POST /node/69beeecda85a0f2cbb32d8d6 HTTP/1.0" 202 Accepted 2026-03-23 19:17:35,795 - lava_callback - INFO - Starting async job submit for node 69beeecda85a0f2cbb32d8d6 2026-03-23 19:17:35,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:17:35,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beeecda85a0f2cbb32d8d6 HTTP/1.1" 200 None 2026-03-23 19:17:35,812 - lava_callback - DEBUG - Processing node 69beeecda85a0f2cbb32d8d6: baseline-arm64-baylibre 2026-03-23 19:17:35,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beeecda85a0f2cbb32d8d6 2026-03-23 19:17:35,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:17:35,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beeecda85a0f2cbb32d8d6 HTTP/1.1" 200 None 2026-03-23 19:17:35,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:17:35,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:17:35,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:17:35,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beeecda85a0f2cbb32d8d6 HTTP/1.1" 200 None 2026-03-23 19:17:35,894 - lava_callback - ERROR - Error processing callback for node 69beeecda85a0f2cbb32d8d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36858 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 19:19:15,575 - lava_callback - INFO - Received callback for node 69beef1ea85a0f2cbb32d8ed INFO: 172.19.0.1:36870 - "POST /node/69beef1ea85a0f2cbb32d8ed HTTP/1.0" 202 Accepted 2026-03-23 19:19:15,581 - lava_callback - INFO - Starting async job submit for node 69beef1ea85a0f2cbb32d8ed 2026-03-23 19:19:15,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:19:15,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beef1ea85a0f2cbb32d8ed HTTP/1.1" 200 None 2026-03-23 19:19:15,597 - lava_callback - DEBUG - Processing node 69beef1ea85a0f2cbb32d8ed: baseline-arm64-baylibre 2026-03-23 19:19:15,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beef1ea85a0f2cbb32d8ed 2026-03-23 19:19:15,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:19:15,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beef1ea85a0f2cbb32d8ed HTTP/1.1" 200 None 2026-03-23 19:19:15,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:19:15,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:19:15,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:19:15,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beef1ea85a0f2cbb32d8ed HTTP/1.1" 200 None 2026-03-23 19:19:15,650 - lava_callback - ERROR - Error processing callback for node 69beef1ea85a0f2cbb32d8ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43936 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-23 19:20:15,620 - lava_callback - INFO - Received callback for node 69beef6aa85a0f2cbb32d8f3 INFO: 172.19.0.1:43948 - "POST /node/69beef6aa85a0f2cbb32d8f3 HTTP/1.0" 202 Accepted 2026-03-23 19:20:15,626 - lava_callback - INFO - Starting async job submit for node 69beef6aa85a0f2cbb32d8f3 2026-03-23 19:20:15,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:20:15,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beef6aa85a0f2cbb32d8f3 HTTP/1.1" 200 None 2026-03-23 19:20:15,642 - lava_callback - DEBUG - Processing node 69beef6aa85a0f2cbb32d8f3: baseline-arm64-baylibre 2026-03-23 19:20:15,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beef6aa85a0f2cbb32d8f3 2026-03-23 19:20:15,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:20:15,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beef6aa85a0f2cbb32d8f3 HTTP/1.1" 200 None 2026-03-23 19:20:15,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:20:15,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:20:15,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:20:15,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beef6aa85a0f2cbb32d8f3 HTTP/1.1" 200 None 2026-03-23 19:20:15,699 - lava_callback - ERROR - Error processing callback for node 69beef6aa85a0f2cbb32d8f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48300 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:22:01,283 - lava_callback - INFO - Received callback for node 69beefc7a85a0f2cbb32d903 INFO: 172.19.0.1:60596 - "POST /node/69beefc7a85a0f2cbb32d903 HTTP/1.0" 202 Accepted 2026-03-23 19:22:01,288 - lava_callback - INFO - Starting async job submit for node 69beefc7a85a0f2cbb32d903 2026-03-23 19:22:01,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:01,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beefc7a85a0f2cbb32d903 HTTP/1.1" 200 None 2026-03-23 19:22:01,307 - lava_callback - DEBUG - Processing node 69beefc7a85a0f2cbb32d903: baseline-arm64-clabbe 2026-03-23 19:22:01,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69beefc7a85a0f2cbb32d903 2026-03-23 19:22:01,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:01,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69beefc7a85a0f2cbb32d903 HTTP/1.1" 200 None 2026-03-23 19:22:01,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:01,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:22:01,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:01,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69beefc7a85a0f2cbb32d903 HTTP/1.1" 200 None 2026-03-23 19:22:01,368 - lava_callback - ERROR - Error processing callback for node 69beefc7a85a0f2cbb32d903: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33500 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:22:44,973 - lava_callback - INFO - Received callback for node 69c18e762b2b51e9ad97aee7 INFO: 172.19.0.1:43556 - "POST /node/69c18e762b2b51e9ad97aee7 HTTP/1.0" 202 Accepted 2026-03-23 19:22:45,021 - lava_callback - INFO - Starting async job submit for node 69c18e762b2b51e9ad97aee7 2026-03-23 19:22:45,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:45,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18e762b2b51e9ad97aee7 HTTP/1.1" 200 None 2026-03-23 19:22:45,063 - lava_callback - DEBUG - Processing node 69c18e762b2b51e9ad97aee7: baseline-arm-pengutronix 2026-03-23 19:22:45,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:22:45,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:22:45,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c18e762b2b51e9ad97aee7/log.txt.gz 2026-03-23 19:22:45,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:22:45,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:22:45,645 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c18e762b2b51e9ad97aee7/lava-logs.yaml 2026-03-23 19:22:45,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:22:45,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:22:45,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69c18e762b2b51e9ad97aee7/lava_callback.json.gz DEBUG: Setup failed for 69c18e762b2b51e9ad97aee7. Transitting job node result: incomplete -> fail 2026-03-23 19:22:45,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:45,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c18e762b2b51e9ad97aee7 HTTP/1.1" 200 None 2026-03-23 19:22:45,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:45,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167842b2b51e9ad977943 HTTP/1.1" 200 None 2026-03-23 19:22:45,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:45,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c18e762b2b51e9ad97aee7 HTTP/1.1" 200 None 2026-03-23 19:22:45,939 - lava_callback - INFO - Completed processing callback for node 69c18e762b2b51e9ad97aee7 INFO: 172.19.0.1:43560 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:22:53,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:22:53,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44860 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:23:21,361 - lava_callback - INFO - Received callback for node 69bef015a85a0f2cbb32d90b INFO: 172.19.0.1:60876 - "POST /node/69bef015a85a0f2cbb32d90b HTTP/1.0" 202 Accepted 2026-03-23 19:23:21,367 - lava_callback - INFO - Starting async job submit for node 69bef015a85a0f2cbb32d90b 2026-03-23 19:23:21,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:21,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef015a85a0f2cbb32d90b HTTP/1.1" 200 None 2026-03-23 19:23:21,384 - lava_callback - DEBUG - Processing node 69bef015a85a0f2cbb32d90b: baseline-arm64-clabbe 2026-03-23 19:23:21,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bef015a85a0f2cbb32d90b 2026-03-23 19:23:21,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:21,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef015a85a0f2cbb32d90b HTTP/1.1" 200 None 2026-03-23 19:23:21,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:21,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:23:21,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:21,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bef015a85a0f2cbb32d90b HTTP/1.1" 200 None 2026-03-23 19:23:21,445 - lava_callback - ERROR - Error processing callback for node 69bef015a85a0f2cbb32d90b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60886 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:23:36,194 - lava_callback - INFO - Received callback for node 69c1854d2b2b51e9ad97ac58 INFO: 172.19.0.1:55346 - "POST /node/69c1854d2b2b51e9ad97ac58 HTTP/1.0" 202 Accepted 2026-03-23 19:23:36,203 - lava_callback - INFO - Starting async job submit for node 69c1854d2b2b51e9ad97ac58 2026-03-23 19:23:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:36,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1854d2b2b51e9ad97ac58 HTTP/1.1" 200 None 2026-03-23 19:23:36,262 - lava_callback - DEBUG - Processing node 69c1854d2b2b51e9ad97ac58: baseline-nfs-arm64 INFO: 172.19.0.1:55362 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:23:37,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:23:37,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:23:37,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1854d2b2b51e9ad97ac58/log.txt.gz 2026-03-23 19:23:38,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:23:38,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:23:38,447 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1854d2b2b51e9ad97ac58/lava-logs.yaml 2026-03-23 19:23:38,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:23:38,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:23:38,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1854d2b2b51e9ad97ac58/lava_callback.json.gz DEBUG: Setup failed for 69c1854d2b2b51e9ad97ac58. Transitting job node result: incomplete -> fail 2026-03-23 19:23:38,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:38,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1854d2b2b51e9ad97ac58 HTTP/1.1" 200 None 2026-03-23 19:23:38,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:38,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 19:23:38,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:38,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1854d2b2b51e9ad97ac58 HTTP/1.1" 200 None 2026-03-23 19:23:38,924 - lava_callback - INFO - Completed processing callback for node 69c1854d2b2b51e9ad97ac58 INFO: 172.19.0.1:41610 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:23:53,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:23:54,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60514 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:24:41,367 - lava_callback - INFO - Received callback for node 69bef064a85a0f2cbb32d919 INFO: 172.19.0.1:39822 - "POST /node/69bef064a85a0f2cbb32d919 HTTP/1.0" 202 Accepted 2026-03-23 19:24:41,373 - lava_callback - INFO - Starting async job submit for node 69bef064a85a0f2cbb32d919 2026-03-23 19:24:41,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:24:41,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef064a85a0f2cbb32d919 HTTP/1.1" 200 None 2026-03-23 19:24:41,389 - lava_callback - DEBUG - Processing node 69bef064a85a0f2cbb32d919: baseline-arm64-clabbe 2026-03-23 19:24:41,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bef064a85a0f2cbb32d919 2026-03-23 19:24:41,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:24:41,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef064a85a0f2cbb32d919 HTTP/1.1" 200 None 2026-03-23 19:24:41,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:24:41,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:24:41,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:24:41,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bef064a85a0f2cbb32d919 HTTP/1.1" 200 None 2026-03-23 19:24:41,459 - lava_callback - ERROR - Error processing callback for node 69bef064a85a0f2cbb32d919: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40018 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:25:41,420 - lava_callback - INFO - Received callback for node 69bef0b1a85a0f2cbb32d920 INFO: 172.19.0.1:45332 - "POST /node/69bef0b1a85a0f2cbb32d920 HTTP/1.0" 202 Accepted 2026-03-23 19:25:41,426 - lava_callback - INFO - Starting async job submit for node 69bef0b1a85a0f2cbb32d920 2026-03-23 19:25:41,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:25:41,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef0b1a85a0f2cbb32d920 HTTP/1.1" 200 None 2026-03-23 19:25:41,443 - lava_callback - DEBUG - Processing node 69bef0b1a85a0f2cbb32d920: baseline-arm64-clabbe 2026-03-23 19:25:41,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bef0b1a85a0f2cbb32d920 2026-03-23 19:25:41,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:25:41,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef0b1a85a0f2cbb32d920 HTTP/1.1" 200 None 2026-03-23 19:25:41,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:25:41,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:25:41,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:25:41,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bef0b1a85a0f2cbb32d920 HTTP/1.1" 200 None 2026-03-23 19:25:41,505 - lava_callback - ERROR - Error processing callback for node 69bef0b1a85a0f2cbb32d920: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44936 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:27:01,449 - lava_callback - INFO - Received callback for node 69bef0ffa85a0f2cbb32d92d INFO: 172.19.0.1:40352 - "POST /node/69bef0ffa85a0f2cbb32d92d HTTP/1.0" 202 Accepted 2026-03-23 19:27:01,455 - lava_callback - INFO - Starting async job submit for node 69bef0ffa85a0f2cbb32d92d 2026-03-23 19:27:01,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:27:01,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef0ffa85a0f2cbb32d92d HTTP/1.1" 200 None 2026-03-23 19:27:01,478 - lava_callback - DEBUG - Processing node 69bef0ffa85a0f2cbb32d92d: baseline-arm64-clabbe 2026-03-23 19:27:01,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bef0ffa85a0f2cbb32d92d 2026-03-23 19:27:01,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:27:01,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef0ffa85a0f2cbb32d92d HTTP/1.1" 200 None 2026-03-23 19:27:01,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:27:01,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:27:01,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:27:01,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bef0ffa85a0f2cbb32d92d HTTP/1.1" 200 None 2026-03-23 19:27:01,544 - lava_callback - ERROR - Error processing callback for node 69bef0ffa85a0f2cbb32d92d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35066 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:28:21,559 - lava_callback - INFO - Received callback for node 69bef14da85a0f2cbb32d936 INFO: 172.19.0.1:55206 - "POST /node/69bef14da85a0f2cbb32d936 HTTP/1.0" 202 Accepted 2026-03-23 19:28:21,564 - lava_callback - INFO - Starting async job submit for node 69bef14da85a0f2cbb32d936 2026-03-23 19:28:21,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:28:21,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef14da85a0f2cbb32d936 HTTP/1.1" 200 None 2026-03-23 19:28:21,581 - lava_callback - DEBUG - Processing node 69bef14da85a0f2cbb32d936: baseline-arm64-clabbe 2026-03-23 19:28:21,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bef14da85a0f2cbb32d936 2026-03-23 19:28:21,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:28:21,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bef14da85a0f2cbb32d936 HTTP/1.1" 200 None 2026-03-23 19:28:21,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:28:21,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-23 19:28:21,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:28:21,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bef14da85a0f2cbb32d936 HTTP/1.1" 200 None 2026-03-23 19:28:21,639 - lava_callback - ERROR - Error processing callback for node 69bef14da85a0f2cbb32d936: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40646 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:30:08,896 - lava_callback - INFO - Received callback for node 69c17ec52b2b51e9ad97a95d INFO: 172.19.0.1:40654 - "POST /node/69c17ec52b2b51e9ad97a95d HTTP/1.0" 202 Accepted 2026-03-23 19:30:08,902 - lava_callback - INFO - Starting async job submit for node 69c17ec52b2b51e9ad97a95d 2026-03-23 19:30:08,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:30:08,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ec52b2b51e9ad97a95d HTTP/1.1" 200 None 2026-03-23 19:30:08,940 - lava_callback - DEBUG - Processing node 69c17ec52b2b51e9ad97a95d: baseline-arm64-broonie 2026-03-23 19:30:09,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:30:09,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:30:09,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec52b2b51e9ad97a95d/log.txt.gz 2026-03-23 19:30:09,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:30:09,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:30:09,716 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec52b2b51e9ad97a95d/lava-logs.yaml 2026-03-23 19:30:09,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:30:09,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:30:09,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec52b2b51e9ad97a95d/lava_callback.json.gz 2026-03-23 19:30:09,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:30:09,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ec52b2b51e9ad97a95d HTTP/1.1" 200 None 2026-03-23 19:30:09,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:30:09,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 19:30:09,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:30:09,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ec52b2b51e9ad97a95d HTTP/1.1" 200 None 2026-03-23 19:30:09,994 - lava_callback - INFO - Completed processing callback for node 69c17ec52b2b51e9ad97a95d INFO: 172.19.0.1:48658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48672 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:30:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:30:24,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50368 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:36:05,696 - lava_callback - INFO - Received callback for node 69c16df22b2b51e9ad97a306 INFO: 172.19.0.1:50372 - "POST /node/69c16df22b2b51e9ad97a306 HTTP/1.0" 202 Accepted 2026-03-23 19:36:05,702 - lava_callback - INFO - Starting async job submit for node 69c16df22b2b51e9ad97a306 2026-03-23 19:36:05,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:36:05,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16df22b2b51e9ad97a306 HTTP/1.1" 200 None 2026-03-23 19:36:05,747 - lava_callback - DEBUG - Processing node 69c16df22b2b51e9ad97a306: baseline-x86 2026-03-23 19:36:06,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:36:06,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:36:06,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df22b2b51e9ad97a306/log.txt.gz 2026-03-23 19:36:06,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:50384 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:36:06,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:36:06,662 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df22b2b51e9ad97a306/lava-logs.yaml 2026-03-23 19:36:06,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:36:06,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:36:06,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69c16df22b2b51e9ad97a306/lava_callback.json.gz 2026-03-23 19:36:06,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:36:06,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c16df22b2b51e9ad97a306 HTTP/1.1" 200 None 2026-03-23 19:36:06,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:36:06,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c167b62b2b51e9ad97796e HTTP/1.1" 200 None 2026-03-23 19:36:06,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:36:06,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c16df22b2b51e9ad97a306 HTTP/1.1" 200 None 2026-03-23 19:36:06,905 - lava_callback - INFO - Completed processing callback for node 69c16df22b2b51e9ad97a306 INFO: 172.19.0.1:47430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47436 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:36:24,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:36:24,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37228 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:45:23,301 - lava_callback - INFO - Received callback for node 69c193a02b2b51e9ad97af79 INFO: 172.19.0.1:49916 - "POST /node/69c193a02b2b51e9ad97af79 HTTP/1.0" 202 Accepted 2026-03-23 19:45:23,309 - lava_callback - INFO - Starting async job submit for node 69c193a02b2b51e9ad97af79 2026-03-23 19:45:23,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:45:23,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c193a02b2b51e9ad97af79 HTTP/1.1" 200 None 2026-03-23 19:45:23,373 - lava_callback - DEBUG - Processing node 69c193a02b2b51e9ad97af79: baseline-nfs-arm64 2026-03-23 19:45:24,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:45:24,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:45:24,695 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c193a02b2b51e9ad97af79/log.txt.gz 2026-03-23 19:45:25,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:45:25,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:45:25,603 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c193a02b2b51e9ad97af79/lava-logs.yaml 2026-03-23 19:45:25,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 19:45:25,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 19:45:25,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c193a02b2b51e9ad97af79/lava_callback.json.gz DEBUG: Setup failed for 69c193a02b2b51e9ad97af79. Transitting job node result: incomplete -> fail 2026-03-23 19:45:25,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:45:25,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c193a02b2b51e9ad97af79 HTTP/1.1" 200 None 2026-03-23 19:45:25,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:45:25,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 19:45:25,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:45:25,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c193a02b2b51e9ad97af79 HTTP/1.1" 200 None 2026-03-23 19:45:26,047 - lava_callback - INFO - Completed processing callback for node 69c193a02b2b51e9ad97af79 INFO: 172.19.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48308 - "GET / HTTP/1.0" 200 OK 2026-03-23 19:45:54,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 19:45:54,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33188 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55544 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.19.0.1:39960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35714 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:05:35,972 - lava_callback - INFO - Received callback for node 69c198602b2b51e9ad97afba INFO: 172.19.0.1:54242 - "POST /node/69c198602b2b51e9ad97afba HTTP/1.0" 202 Accepted 2026-03-23 20:05:35,981 - lava_callback - INFO - Starting async job submit for node 69c198602b2b51e9ad97afba 2026-03-23 20:05:36,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:05:36,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c198602b2b51e9ad97afba HTTP/1.1" 200 None 2026-03-23 20:05:36,065 - lava_callback - DEBUG - Processing node 69c198602b2b51e9ad97afba: baseline-nfs-arm64 INFO: 172.19.0.1:54252 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:05:37,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:05:37,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:05:37,389 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c198602b2b51e9ad97afba/log.txt.gz 2026-03-23 20:05:38,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:05:38,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:05:38,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c198602b2b51e9ad97afba/lava-logs.yaml 2026-03-23 20:05:38,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:05:38,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:05:38,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c198602b2b51e9ad97afba/lava_callback.json.gz DEBUG: Setup failed for 69c198602b2b51e9ad97afba. Transitting job node result: incomplete -> fail 2026-03-23 20:05:38,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:05:38,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c198602b2b51e9ad97afba HTTP/1.1" 200 None 2026-03-23 20:05:38,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:05:38,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 20:05:38,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:05:38,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c198602b2b51e9ad97afba HTTP/1.1" 200 None 2026-03-23 20:05:38,775 - lava_callback - INFO - Completed processing callback for node 69c198602b2b51e9ad97afba INFO: 172.19.0.1:46356 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:05:54,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:05:54,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37312 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:08:38,470 - lava_callback - INFO - Received callback for node 69befac2a85a0f2cbb32d9c9 INFO: 172.19.0.1:37320 - "POST /node/69befac2a85a0f2cbb32d9c9 HTTP/1.0" 202 Accepted 2026-03-23 20:08:38,477 - lava_callback - INFO - Starting async job submit for node 69befac2a85a0f2cbb32d9c9 2026-03-23 20:08:38,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:08:38,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befac2a85a0f2cbb32d9c9 HTTP/1.1" 200 None 2026-03-23 20:08:38,499 - lava_callback - DEBUG - Processing node 69befac2a85a0f2cbb32d9c9: baseline-arm64-baylibre 2026-03-23 20:08:38,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befac2a85a0f2cbb32d9c9 2026-03-23 20:08:38,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:08:38,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befac2a85a0f2cbb32d9c9 HTTP/1.1" 200 None 2026-03-23 20:08:38,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:08:38,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:08:38,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:08:38,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befac2a85a0f2cbb32d9c9 HTTP/1.1" 200 None 2026-03-23 20:08:38,582 - lava_callback - ERROR - Error processing callback for node 69befac2a85a0f2cbb32d9c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57408 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:11:38,654 - lava_callback - INFO - Received callback for node 69befb71a85a0f2cbb32d9dd INFO: 172.19.0.1:57416 - "POST /node/69befb71a85a0f2cbb32d9dd HTTP/1.0" 202 Accepted 2026-03-23 20:11:38,660 - lava_callback - INFO - Starting async job submit for node 69befb71a85a0f2cbb32d9dd 2026-03-23 20:11:38,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:11:38,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befb71a85a0f2cbb32d9dd HTTP/1.1" 200 None 2026-03-23 20:11:38,676 - lava_callback - DEBUG - Processing node 69befb71a85a0f2cbb32d9dd: baseline-arm64-baylibre 2026-03-23 20:11:38,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befb71a85a0f2cbb32d9dd 2026-03-23 20:11:38,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:11:38,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befb71a85a0f2cbb32d9dd HTTP/1.1" 200 None 2026-03-23 20:11:38,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:11:38,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:11:38,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:11:38,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befb71a85a0f2cbb32d9dd HTTP/1.1" 200 None 2026-03-23 20:11:38,751 - lava_callback - ERROR - Error processing callback for node 69befb71a85a0f2cbb32d9dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52128 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:12:58,839 - lava_callback - INFO - Received callback for node 69befbbda85a0f2cbb32d9ec INFO: 172.19.0.1:52136 - "POST /node/69befbbda85a0f2cbb32d9ec HTTP/1.0" 202 Accepted 2026-03-23 20:12:58,845 - lava_callback - INFO - Starting async job submit for node 69befbbda85a0f2cbb32d9ec 2026-03-23 20:12:58,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:12:58,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befbbda85a0f2cbb32d9ec HTTP/1.1" 200 None 2026-03-23 20:12:58,879 - lava_callback - DEBUG - Processing node 69befbbda85a0f2cbb32d9ec: baseline-arm64-baylibre 2026-03-23 20:12:58,880 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befbbda85a0f2cbb32d9ec 2026-03-23 20:12:58,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:12:58,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befbbda85a0f2cbb32d9ec HTTP/1.1" 200 None 2026-03-23 20:12:58,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:12:58,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:12:58,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:12:58,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befbbda85a0f2cbb32d9ec HTTP/1.1" 200 None 2026-03-23 20:12:58,952 - lava_callback - ERROR - Error processing callback for node 69befbbda85a0f2cbb32d9ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46786 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:14:18,797 - lava_callback - INFO - Received callback for node 69befc0aa85a0f2cbb32d9f5 INFO: 172.19.0.1:46792 - "POST /node/69befc0aa85a0f2cbb32d9f5 HTTP/1.0" 202 Accepted 2026-03-23 20:14:18,802 - lava_callback - INFO - Starting async job submit for node 69befc0aa85a0f2cbb32d9f5 2026-03-23 20:14:18,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:14:18,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befc0aa85a0f2cbb32d9f5 HTTP/1.1" 200 None 2026-03-23 20:14:18,847 - lava_callback - DEBUG - Processing node 69befc0aa85a0f2cbb32d9f5: baseline-arm64-baylibre 2026-03-23 20:14:18,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befc0aa85a0f2cbb32d9f5 2026-03-23 20:14:18,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:14:18,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befc0aa85a0f2cbb32d9f5 HTTP/1.1" 200 None 2026-03-23 20:14:18,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:14:18,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:14:18,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:14:18,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befc0aa85a0f2cbb32d9f5 HTTP/1.1" 200 None 2026-03-23 20:14:18,944 - lava_callback - ERROR - Error processing callback for node 69befc0aa85a0f2cbb32d9f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34048 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:15:38,836 - lava_callback - INFO - Received callback for node 69befc58a85a0f2cbb32da04 INFO: 172.19.0.1:34054 - "POST /node/69befc58a85a0f2cbb32da04 HTTP/1.0" 202 Accepted 2026-03-23 20:15:38,841 - lava_callback - INFO - Starting async job submit for node 69befc58a85a0f2cbb32da04 2026-03-23 20:15:38,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:15:38,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befc58a85a0f2cbb32da04 HTTP/1.1" 200 None 2026-03-23 20:15:38,857 - lava_callback - DEBUG - Processing node 69befc58a85a0f2cbb32da04: baseline-arm64-baylibre 2026-03-23 20:15:38,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befc58a85a0f2cbb32da04 2026-03-23 20:15:38,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:15:38,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befc58a85a0f2cbb32da04 HTTP/1.1" 200 None 2026-03-23 20:15:38,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:15:38,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:15:38,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:15:38,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befc58a85a0f2cbb32da04 HTTP/1.1" 200 None 2026-03-23 20:15:38,920 - lava_callback - ERROR - Error processing callback for node 69befc58a85a0f2cbb32da04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52996 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:17:03,677 - lava_callback - INFO - Received callback for node 69befca9a85a0f2cbb32da0d INFO: 172.19.0.1:32964 - "POST /node/69befca9a85a0f2cbb32da0d HTTP/1.0" 202 Accepted 2026-03-23 20:17:03,683 - lava_callback - INFO - Starting async job submit for node 69befca9a85a0f2cbb32da0d 2026-03-23 20:17:03,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:17:03,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befca9a85a0f2cbb32da0d HTTP/1.1" 200 None 2026-03-23 20:17:03,699 - lava_callback - DEBUG - Processing node 69befca9a85a0f2cbb32da0d: baseline-arm64-clabbe 2026-03-23 20:17:03,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befca9a85a0f2cbb32da0d 2026-03-23 20:17:03,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:17:03,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befca9a85a0f2cbb32da0d HTTP/1.1" 200 None 2026-03-23 20:17:03,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:17:03,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:17:03,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:17:03,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befca9a85a0f2cbb32da0d HTTP/1.1" 200 None 2026-03-23 20:17:03,758 - lava_callback - ERROR - Error processing callback for node 69befca9a85a0f2cbb32da0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57696 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:18:03,728 - lava_callback - INFO - Received callback for node 69befcf4a85a0f2cbb32da1c INFO: 172.19.0.1:49402 - "POST /node/69befcf4a85a0f2cbb32da1c HTTP/1.0" 202 Accepted 2026-03-23 20:18:03,734 - lava_callback - INFO - Starting async job submit for node 69befcf4a85a0f2cbb32da1c 2026-03-23 20:18:03,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:18:03,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befcf4a85a0f2cbb32da1c HTTP/1.1" 200 None 2026-03-23 20:18:03,750 - lava_callback - DEBUG - Processing node 69befcf4a85a0f2cbb32da1c: baseline-arm64-clabbe 2026-03-23 20:18:03,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befcf4a85a0f2cbb32da1c 2026-03-23 20:18:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:18:03,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befcf4a85a0f2cbb32da1c HTTP/1.1" 200 None 2026-03-23 20:18:03,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:18:03,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:18:03,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:18:03,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befcf4a85a0f2cbb32da1c HTTP/1.1" 200 None 2026-03-23 20:18:03,809 - lava_callback - ERROR - Error processing callback for node 69befcf4a85a0f2cbb32da1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34992 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:19:23,743 - lava_callback - INFO - Received callback for node 69befd40a85a0f2cbb32da25 INFO: 172.19.0.1:43986 - "POST /node/69befd40a85a0f2cbb32da25 HTTP/1.0" 202 Accepted 2026-03-23 20:19:23,749 - lava_callback - INFO - Starting async job submit for node 69befd40a85a0f2cbb32da25 2026-03-23 20:19:23,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:19:23,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befd40a85a0f2cbb32da25 HTTP/1.1" 200 None 2026-03-23 20:19:23,765 - lava_callback - DEBUG - Processing node 69befd40a85a0f2cbb32da25: baseline-arm64-clabbe 2026-03-23 20:19:23,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befd40a85a0f2cbb32da25 2026-03-23 20:19:23,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:19:23,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befd40a85a0f2cbb32da25 HTTP/1.1" 200 None 2026-03-23 20:19:23,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:19:23,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:19:23,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:19:23,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befd40a85a0f2cbb32da25 HTTP/1.1" 200 None 2026-03-23 20:19:23,822 - lava_callback - ERROR - Error processing callback for node 69befd40a85a0f2cbb32da25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57526 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:20:43,794 - lava_callback - INFO - Received callback for node 69befd8fa85a0f2cbb32da33 INFO: 172.19.0.1:32878 - "POST /node/69befd8fa85a0f2cbb32da33 HTTP/1.0" 202 Accepted 2026-03-23 20:20:43,799 - lava_callback - INFO - Starting async job submit for node 69befd8fa85a0f2cbb32da33 2026-03-23 20:20:43,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:20:43,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befd8fa85a0f2cbb32da33 HTTP/1.1" 200 None 2026-03-23 20:20:43,815 - lava_callback - DEBUG - Processing node 69befd8fa85a0f2cbb32da33: baseline-arm64-clabbe 2026-03-23 20:20:43,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befd8fa85a0f2cbb32da33 2026-03-23 20:20:43,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:20:43,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befd8fa85a0f2cbb32da33 HTTP/1.1" 200 None 2026-03-23 20:20:43,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:20:43,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:20:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:20:43,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befd8fa85a0f2cbb32da33 HTTP/1.1" 200 None 2026-03-23 20:20:43,872 - lava_callback - ERROR - Error processing callback for node 69befd8fa85a0f2cbb32da33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55988 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:22:03,865 - lava_callback - INFO - Received callback for node 69befddca85a0f2cbb32da41 INFO: 172.19.0.1:52528 - "POST /node/69befddca85a0f2cbb32da41 HTTP/1.0" 202 Accepted 2026-03-23 20:22:03,870 - lava_callback - INFO - Starting async job submit for node 69befddca85a0f2cbb32da41 2026-03-23 20:22:03,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:22:03,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befddca85a0f2cbb32da41 HTTP/1.1" 200 None 2026-03-23 20:22:03,891 - lava_callback - DEBUG - Processing node 69befddca85a0f2cbb32da41: baseline-arm64-clabbe 2026-03-23 20:22:03,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befddca85a0f2cbb32da41 2026-03-23 20:22:03,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:22:03,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befddca85a0f2cbb32da41 HTTP/1.1" 200 None 2026-03-23 20:22:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:22:03,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:22:03,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:22:03,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befddca85a0f2cbb32da41 HTTP/1.1" 200 None 2026-03-23 20:22:03,944 - lava_callback - ERROR - Error processing callback for node 69befddca85a0f2cbb32da41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42790 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:23:23,914 - lava_callback - INFO - Received callback for node 69befe28a85a0f2cbb32da4c INFO: 172.19.0.1:48500 - "POST /node/69befe28a85a0f2cbb32da4c HTTP/1.0" 202 Accepted 2026-03-23 20:23:23,920 - lava_callback - INFO - Starting async job submit for node 69befe28a85a0f2cbb32da4c 2026-03-23 20:23:23,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:23:23,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befe28a85a0f2cbb32da4c HTTP/1.1" 200 None 2026-03-23 20:23:23,937 - lava_callback - DEBUG - Processing node 69befe28a85a0f2cbb32da4c: baseline-arm64-clabbe 2026-03-23 20:23:23,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69befe28a85a0f2cbb32da4c 2026-03-23 20:23:23,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:23:23,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69befe28a85a0f2cbb32da4c HTTP/1.1" 200 None 2026-03-23 20:23:23,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:23:24,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bde369d54b5122738c3da2 HTTP/1.1" 200 None 2026-03-23 20:23:24,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:23:24,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69befe28a85a0f2cbb32da4c HTTP/1.1" 200 None 2026-03-23 20:23:24,053 - lava_callback - ERROR - Error processing callback for node 69befe28a85a0f2cbb32da4c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33614 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:27:50,923 - lava_callback - INFO - Received callback for node 69c17ecd2b2b51e9ad97a976 INFO: 172.19.0.1:60538 - "POST /node/69c17ecd2b2b51e9ad97a976 HTTP/1.0" 202 Accepted 2026-03-23 20:27:50,929 - lava_callback - INFO - Starting async job submit for node 69c17ecd2b2b51e9ad97a976 2026-03-23 20:27:50,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:27:50,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ecd2b2b51e9ad97a976 HTTP/1.1" 200 None 2026-03-23 20:27:50,967 - lava_callback - DEBUG - Processing node 69c17ecd2b2b51e9ad97a976: baseline-arm64-broonie 2026-03-23 20:27:51,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:27:51,367 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:27:51,369 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ecd2b2b51e9ad97a976/log.txt.gz 2026-03-23 20:27:51,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:27:51,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:27:51,712 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ecd2b2b51e9ad97a976/lava-logs.yaml 2026-03-23 20:27:51,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:27:51,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:27:51,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ecd2b2b51e9ad97a976/lava_callback.json.gz 2026-03-23 20:27:51,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:27:51,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ecd2b2b51e9ad97a976 HTTP/1.1" 200 None 2026-03-23 20:27:51,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:27:51,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 20:27:51,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:27:51,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ecd2b2b51e9ad97a976 HTTP/1.1" 200 None 2026-03-23 20:27:51,977 - lava_callback - INFO - Completed processing callback for node 69c17ecd2b2b51e9ad97a976 2026-03-23 20:27:54,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:27:54,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60412 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:33:40,312 - lava_callback - INFO - Received callback for node 69c17ec82b2b51e9ad97a96c INFO: 172.19.0.1:51378 - "POST /node/69c17ec82b2b51e9ad97a96c HTTP/1.0" 202 Accepted 2026-03-23 20:33:40,318 - lava_callback - INFO - Starting async job submit for node 69c17ec82b2b51e9ad97a96c 2026-03-23 20:33:40,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:33:40,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ec82b2b51e9ad97a96c HTTP/1.1" 200 None 2026-03-23 20:33:40,356 - lava_callback - DEBUG - Processing node 69c17ec82b2b51e9ad97a96c: baseline-arm64-broonie 2026-03-23 20:33:40,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:33:40,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:33:40,740 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec82b2b51e9ad97a96c/log.txt.gz 2026-03-23 20:33:40,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:33:41,096 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:33:41,098 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec82b2b51e9ad97a96c/lava-logs.yaml 2026-03-23 20:33:41,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 20:33:41,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 20:33:41,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69c17ec82b2b51e9ad97a96c/lava_callback.json.gz 2026-03-23 20:33:41,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:33:41,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c17ec82b2b51e9ad97a96c HTTP/1.1" 200 None 2026-03-23 20:33:41,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:33:41,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 20:33:41,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:33:41,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c17ec82b2b51e9ad97a96c HTTP/1.1" 200 None 2026-03-23 20:33:41,335 - lava_callback - INFO - Completed processing callback for node 69c17ec82b2b51e9ad97a96c INFO: 172.19.0.1:51386 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:33:54,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:33:54,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47912 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:42:20,662 - lava_callback - INFO - Received callback for node 69bf029da85a0f2cbb32da7d INFO: 172.19.0.1:44614 - "POST /node/69bf029da85a0f2cbb32da7d HTTP/1.0" 202 Accepted 2026-03-23 20:42:20,668 - lava_callback - INFO - Starting async job submit for node 69bf029da85a0f2cbb32da7d 2026-03-23 20:42:20,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:42:20,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf029da85a0f2cbb32da7d HTTP/1.1" 200 None 2026-03-23 20:42:20,683 - lava_callback - DEBUG - Processing node 69bf029da85a0f2cbb32da7d: baseline-arm-baylibre 2026-03-23 20:42:20,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf029da85a0f2cbb32da7d 2026-03-23 20:42:20,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:42:20,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf029da85a0f2cbb32da7d HTTP/1.1" 200 None 2026-03-23 20:42:20,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:42:20,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 20:42:20,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:42:20,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf029da85a0f2cbb32da7d HTTP/1.1" 200 None 2026-03-23 20:42:20,735 - lava_callback - ERROR - Error processing callback for node 69bf029da85a0f2cbb32da7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46060 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:47:04,976 - lava_callback - INFO - Received callback for node 69bf03bda85a0f2cbb32dae9 INFO: 172.19.0.1:46758 - "POST /node/69bf03bda85a0f2cbb32dae9 HTTP/1.0" 202 Accepted 2026-03-23 20:47:04,981 - lava_callback - INFO - Starting async job submit for node 69bf03bda85a0f2cbb32dae9 2026-03-23 20:47:04,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf03bda85a0f2cbb32dae9 HTTP/1.1" 200 None 2026-03-23 20:47:04,997 - lava_callback - DEBUG - Processing node 69bf03bda85a0f2cbb32dae9: baseline-arm-clabbe 2026-03-23 20:47:04,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf03bda85a0f2cbb32dae9 2026-03-23 20:47:04,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:05,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf03bda85a0f2cbb32dae9 HTTP/1.1" 200 None 2026-03-23 20:47:05,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:05,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 20:47:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:05,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf03bda85a0f2cbb32dae9 HTTP/1.1" 200 None 2026-03-23 20:47:05,062 - lava_callback - ERROR - Error processing callback for node 69bf03bda85a0f2cbb32dae9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:47:44,944 - lava_callback - INFO - Received callback for node 69bf03e1a85a0f2cbb32daf9 INFO: 172.19.0.1:56422 - "POST /node/69bf03e1a85a0f2cbb32daf9 HTTP/1.0" 202 Accepted 2026-03-23 20:47:44,950 - lava_callback - INFO - Starting async job submit for node 69bf03e1a85a0f2cbb32daf9 2026-03-23 20:47:44,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:44,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf03e1a85a0f2cbb32daf9 HTTP/1.1" 200 None 2026-03-23 20:47:44,966 - lava_callback - DEBUG - Processing node 69bf03e1a85a0f2cbb32daf9: baseline-arm-clabbe 2026-03-23 20:47:44,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf03e1a85a0f2cbb32daf9 2026-03-23 20:47:44,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:44,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf03e1a85a0f2cbb32daf9 HTTP/1.1" 200 None 2026-03-23 20:47:44,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:44,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 20:47:44,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:47:45,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf03e1a85a0f2cbb32daf9 HTTP/1.1" 200 None 2026-03-23 20:47:45,022 - lava_callback - ERROR - Error processing callback for node 69bf03e1a85a0f2cbb32daf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36868 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:48:25,012 - lava_callback - INFO - Received callback for node 69bf040ba85a0f2cbb32db0b INFO: 172.19.0.1:43632 - "POST /node/69bf040ba85a0f2cbb32db0b HTTP/1.0" 202 Accepted 2026-03-23 20:48:25,017 - lava_callback - INFO - Starting async job submit for node 69bf040ba85a0f2cbb32db0b 2026-03-23 20:48:25,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:48:25,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf040ba85a0f2cbb32db0b HTTP/1.1" 200 None 2026-03-23 20:48:25,034 - lava_callback - DEBUG - Processing node 69bf040ba85a0f2cbb32db0b: baseline-arm-clabbe 2026-03-23 20:48:25,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf040ba85a0f2cbb32db0b 2026-03-23 20:48:25,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:48:25,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf040ba85a0f2cbb32db0b HTTP/1.1" 200 None 2026-03-23 20:48:25,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:48:25,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 20:48:25,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:48:25,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf040ba85a0f2cbb32db0b HTTP/1.1" 200 None 2026-03-23 20:48:25,099 - lava_callback - ERROR - Error processing callback for node 69bf040ba85a0f2cbb32db0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34764 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:49:04,988 - lava_callback - INFO - Received callback for node 69bf042fa85a0f2cbb32db18 INFO: 172.19.0.1:46280 - "POST /node/69bf042fa85a0f2cbb32db18 HTTP/1.0" 202 Accepted 2026-03-23 20:49:04,994 - lava_callback - INFO - Starting async job submit for node 69bf042fa85a0f2cbb32db18 2026-03-23 20:49:04,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:05,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf042fa85a0f2cbb32db18 HTTP/1.1" 200 None 2026-03-23 20:49:05,011 - lava_callback - DEBUG - Processing node 69bf042fa85a0f2cbb32db18: baseline-arm-clabbe 2026-03-23 20:49:05,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf042fa85a0f2cbb32db18 2026-03-23 20:49:05,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:05,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf042fa85a0f2cbb32db18 HTTP/1.1" 200 None 2026-03-23 20:49:05,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:05,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 20:49:05,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:05,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf042fa85a0f2cbb32db18 HTTP/1.1" 200 None 2026-03-23 20:49:05,072 - lava_callback - ERROR - Error processing callback for node 69bf042fa85a0f2cbb32db18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41084 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:49:45,066 - lava_callback - INFO - Received callback for node 69bf0454a85a0f2cbb32db27 INFO: 172.19.0.1:41212 - "POST /node/69bf0454a85a0f2cbb32db27 HTTP/1.0" 202 Accepted 2026-03-23 20:49:45,071 - lava_callback - INFO - Starting async job submit for node 69bf0454a85a0f2cbb32db27 2026-03-23 20:49:45,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:45,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0454a85a0f2cbb32db27 HTTP/1.1" 200 None 2026-03-23 20:49:45,087 - lava_callback - DEBUG - Processing node 69bf0454a85a0f2cbb32db27: baseline-arm-clabbe 2026-03-23 20:49:45,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0454a85a0f2cbb32db27 2026-03-23 20:49:45,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:45,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0454a85a0f2cbb32db27 HTTP/1.1" 200 None 2026-03-23 20:49:45,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:45,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be544f448e074b3ffe162d HTTP/1.1" 200 None 2026-03-23 20:49:45,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:49:45,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0454a85a0f2cbb32db27 HTTP/1.1" 200 None 2026-03-23 20:49:45,146 - lava_callback - ERROR - Error processing callback for node 69bf0454a85a0f2cbb32db27: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42126 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:57:01,215 - lava_callback - INFO - Received callback for node 69bf0610a85a0f2cbb32db53 INFO: 172.19.0.1:53402 - "POST /node/69bf0610a85a0f2cbb32db53 HTTP/1.0" 202 Accepted 2026-03-23 20:57:01,220 - lava_callback - INFO - Starting async job submit for node 69bf0610a85a0f2cbb32db53 2026-03-23 20:57:01,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:01,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0610a85a0f2cbb32db53 HTTP/1.1" 200 None 2026-03-23 20:57:01,237 - lava_callback - DEBUG - Processing node 69bf0610a85a0f2cbb32db53: baseline-arm-baylibre 2026-03-23 20:57:01,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0610a85a0f2cbb32db53 2026-03-23 20:57:01,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:01,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0610a85a0f2cbb32db53 HTTP/1.1" 200 None 2026-03-23 20:57:01,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:01,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 20:57:01,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:01,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0610a85a0f2cbb32db53 HTTP/1.1" 200 None 2026-03-23 20:57:01,295 - lava_callback - ERROR - Error processing callback for node 69bf0610a85a0f2cbb32db53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56080 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:57:41,099 - lava_callback - INFO - Received callback for node 69bf0636a85a0f2cbb32db61 INFO: 172.19.0.1:50738 - "POST /node/69bf0636a85a0f2cbb32db61 HTTP/1.0" 202 Accepted 2026-03-23 20:57:41,105 - lava_callback - INFO - Starting async job submit for node 69bf0636a85a0f2cbb32db61 2026-03-23 20:57:41,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:41,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0636a85a0f2cbb32db61 HTTP/1.1" 200 None 2026-03-23 20:57:41,121 - lava_callback - DEBUG - Processing node 69bf0636a85a0f2cbb32db61: baseline-arm-baylibre 2026-03-23 20:57:41,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0636a85a0f2cbb32db61 2026-03-23 20:57:41,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:41,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0636a85a0f2cbb32db61 HTTP/1.1" 200 None 2026-03-23 20:57:41,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:41,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 20:57:41,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:57:41,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0636a85a0f2cbb32db61 HTTP/1.1" 200 None 2026-03-23 20:57:41,173 - lava_callback - ERROR - Error processing callback for node 69bf0636a85a0f2cbb32db61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36158 - "GET / HTTP/1.0" 200 OK 2026-03-23 20:58:21,189 - lava_callback - INFO - Received callback for node 69bf0661a85a0f2cbb32db6f INFO: 172.19.0.1:41462 - "POST /node/69bf0661a85a0f2cbb32db6f HTTP/1.0" 202 Accepted 2026-03-23 20:58:21,194 - lava_callback - INFO - Starting async job submit for node 69bf0661a85a0f2cbb32db6f 2026-03-23 20:58:21,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:58:21,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0661a85a0f2cbb32db6f HTTP/1.1" 200 None 2026-03-23 20:58:21,210 - lava_callback - DEBUG - Processing node 69bf0661a85a0f2cbb32db6f: baseline-arm-baylibre 2026-03-23 20:58:21,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0661a85a0f2cbb32db6f 2026-03-23 20:58:21,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:58:21,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0661a85a0f2cbb32db6f HTTP/1.1" 200 None 2026-03-23 20:58:21,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:58:21,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 20:58:21,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 20:58:21,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0661a85a0f2cbb32db6f HTTP/1.1" 200 None 2026-03-23 20:58:21,278 - lava_callback - ERROR - Error processing callback for node 69bf0661a85a0f2cbb32db6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60560 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:00:25,531 - lava_callback - INFO - Received callback for node 69bf06daa85a0f2cbb32db82 INFO: 172.19.0.1:59344 - "POST /node/69bf06daa85a0f2cbb32db82 HTTP/1.0" 202 Accepted 2026-03-23 21:00:25,536 - lava_callback - INFO - Starting async job submit for node 69bf06daa85a0f2cbb32db82 2026-03-23 21:00:25,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:00:25,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf06daa85a0f2cbb32db82 HTTP/1.1" 200 None 2026-03-23 21:00:25,552 - lava_callback - DEBUG - Processing node 69bf06daa85a0f2cbb32db82: baseline-arm-clabbe 2026-03-23 21:00:25,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf06daa85a0f2cbb32db82 2026-03-23 21:00:25,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:00:25,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf06daa85a0f2cbb32db82 HTTP/1.1" 200 None 2026-03-23 21:00:25,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:00:25,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:00:25,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:00:25,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf06daa85a0f2cbb32db82 HTTP/1.1" 200 None 2026-03-23 21:00:25,605 - lava_callback - ERROR - Error processing callback for node 69bf06daa85a0f2cbb32db82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46118 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:01:05,527 - lava_callback - INFO - Received callback for node 69bf0702a85a0f2cbb32db8f INFO: 172.19.0.1:53400 - "POST /node/69bf0702a85a0f2cbb32db8f HTTP/1.0" 202 Accepted 2026-03-23 21:01:05,532 - lava_callback - INFO - Starting async job submit for node 69bf0702a85a0f2cbb32db8f 2026-03-23 21:01:05,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:01:05,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0702a85a0f2cbb32db8f HTTP/1.1" 200 None 2026-03-23 21:01:05,564 - lava_callback - DEBUG - Processing node 69bf0702a85a0f2cbb32db8f: baseline-arm-clabbe 2026-03-23 21:01:05,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0702a85a0f2cbb32db8f 2026-03-23 21:01:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:01:05,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0702a85a0f2cbb32db8f HTTP/1.1" 200 None 2026-03-23 21:01:05,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:01:05,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:01:05,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:53414 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:01:05,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0702a85a0f2cbb32db8f HTTP/1.1" 200 None 2026-03-23 21:01:05,621 - lava_callback - ERROR - Error processing callback for node 69bf0702a85a0f2cbb32db8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53940 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:01:41,320 - lava_callback - INFO - Received callback for node 69bf0721a85a0f2cbb32db9b INFO: 172.19.0.1:56320 - "POST /node/69bf0721a85a0f2cbb32db9b HTTP/1.0" 202 Accepted 2026-03-23 21:01:41,326 - lava_callback - INFO - Starting async job submit for node 69bf0721a85a0f2cbb32db9b 2026-03-23 21:01:41,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:01:41,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0721a85a0f2cbb32db9b HTTP/1.1" 200 None 2026-03-23 21:01:41,342 - lava_callback - DEBUG - Processing node 69bf0721a85a0f2cbb32db9b: baseline-arm-baylibre 2026-03-23 21:01:41,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0721a85a0f2cbb32db9b 2026-03-23 21:01:41,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:01:41,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0721a85a0f2cbb32db9b HTTP/1.1" 200 None 2026-03-23 21:01:41,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:01:41,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:01:41,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:01:41,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0721a85a0f2cbb32db9b HTTP/1.1" 200 None 2026-03-23 21:01:41,403 - lava_callback - ERROR - Error processing callback for node 69bf0721a85a0f2cbb32db9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51168 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:02:05,645 - lava_callback - INFO - Received callback for node 69bf0749a85a0f2cbb32dba6 INFO: 172.19.0.1:51170 - "POST /node/69bf0749a85a0f2cbb32dba6 HTTP/1.0" 202 Accepted 2026-03-23 21:02:05,651 - lava_callback - INFO - Starting async job submit for node 69bf0749a85a0f2cbb32dba6 2026-03-23 21:02:05,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:05,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0749a85a0f2cbb32dba6 HTTP/1.1" 200 None 2026-03-23 21:02:05,667 - lava_callback - DEBUG - Processing node 69bf0749a85a0f2cbb32dba6: baseline-arm-clabbe 2026-03-23 21:02:05,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0749a85a0f2cbb32dba6 2026-03-23 21:02:05,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:05,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0749a85a0f2cbb32dba6 HTTP/1.1" 200 None 2026-03-23 21:02:05,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:05,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:02:05,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:05,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0749a85a0f2cbb32dba6 HTTP/1.1" 200 None 2026-03-23 21:02:05,731 - lava_callback - ERROR - Error processing callback for node 69bf0749a85a0f2cbb32dba6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43524 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:02:41,396 - lava_callback - INFO - Received callback for node 69bf0769a85a0f2cbb32dbb6 INFO: 172.19.0.1:48712 - "POST /node/69bf0769a85a0f2cbb32dbb6 HTTP/1.0" 202 Accepted 2026-03-23 21:02:41,402 - lava_callback - INFO - Starting async job submit for node 69bf0769a85a0f2cbb32dbb6 2026-03-23 21:02:41,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:41,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0769a85a0f2cbb32dbb6 HTTP/1.1" 200 None 2026-03-23 21:02:41,419 - lava_callback - DEBUG - Processing node 69bf0769a85a0f2cbb32dbb6: baseline-arm-baylibre 2026-03-23 21:02:41,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0769a85a0f2cbb32dbb6 2026-03-23 21:02:41,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:41,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0769a85a0f2cbb32dbb6 HTTP/1.1" 200 None 2026-03-23 21:02:41,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:41,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:02:41,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:02:41,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0769a85a0f2cbb32dbb6 HTTP/1.1" 200 None 2026-03-23 21:02:41,476 - lava_callback - ERROR - Error processing callback for node 69bf0769a85a0f2cbb32dbb6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34584 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:03:25,637 - lava_callback - INFO - Received callback for node 69bf0791a85a0f2cbb32dbc4 INFO: 172.19.0.1:59502 - "POST /node/69bf0791a85a0f2cbb32dbc4 HTTP/1.0" 202 Accepted 2026-03-23 21:03:25,642 - lava_callback - INFO - Starting async job submit for node 69bf0791a85a0f2cbb32dbc4 2026-03-23 21:03:25,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:03:25,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0791a85a0f2cbb32dbc4 HTTP/1.1" 200 None 2026-03-23 21:03:25,659 - lava_callback - DEBUG - Processing node 69bf0791a85a0f2cbb32dbc4: baseline-arm-clabbe 2026-03-23 21:03:25,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0791a85a0f2cbb32dbc4 2026-03-23 21:03:25,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:03:25,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0791a85a0f2cbb32dbc4 HTTP/1.1" 200 None 2026-03-23 21:03:25,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:03:25,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:03:25,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:03:25,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0791a85a0f2cbb32dbc4 HTTP/1.1" 200 None 2026-03-23 21:03:25,718 - lava_callback - ERROR - Error processing callback for node 69bf0791a85a0f2cbb32dbc4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46298 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:04:05,633 - lava_callback - INFO - Received callback for node 69bf07b4a85a0f2cbb32dbd1 INFO: 172.19.0.1:44824 - "POST /node/69bf07b4a85a0f2cbb32dbd1 HTTP/1.0" 202 Accepted 2026-03-23 21:04:05,638 - lava_callback - INFO - Starting async job submit for node 69bf07b4a85a0f2cbb32dbd1 2026-03-23 21:04:05,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:05,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf07b4a85a0f2cbb32dbd1 HTTP/1.1" 200 None INFO: 172.19.0.1:44830 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:04:05,658 - lava_callback - DEBUG - Processing node 69bf07b4a85a0f2cbb32dbd1: baseline-arm-clabbe 2026-03-23 21:04:05,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf07b4a85a0f2cbb32dbd1 2026-03-23 21:04:05,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:05,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf07b4a85a0f2cbb32dbd1 HTTP/1.1" 200 None 2026-03-23 21:04:05,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:05,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:04:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:05,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf07b4a85a0f2cbb32dbd1 HTTP/1.1" 200 None 2026-03-23 21:04:05,737 - lava_callback - ERROR - Error processing callback for node 69bf07b4a85a0f2cbb32dbd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42328 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:04:41,527 - lava_callback - INFO - Received callback for node 69bf07d5a85a0f2cbb32dbde INFO: 172.19.0.1:33714 - "POST /node/69bf07d5a85a0f2cbb32dbde HTTP/1.0" 202 Accepted 2026-03-23 21:04:41,532 - lava_callback - INFO - Starting async job submit for node 69bf07d5a85a0f2cbb32dbde 2026-03-23 21:04:41,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:41,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf07d5a85a0f2cbb32dbde HTTP/1.1" 200 None 2026-03-23 21:04:41,557 - lava_callback - DEBUG - Processing node 69bf07d5a85a0f2cbb32dbde: baseline-arm-baylibre 2026-03-23 21:04:41,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf07d5a85a0f2cbb32dbde 2026-03-23 21:04:41,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:41,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf07d5a85a0f2cbb32dbde HTTP/1.1" 200 None 2026-03-23 21:04:41,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:41,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:04:41,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:04:41,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf07d5a85a0f2cbb32dbde HTTP/1.1" 200 None 2026-03-23 21:04:41,633 - lava_callback - ERROR - Error processing callback for node 69bf07d5a85a0f2cbb32dbde: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51508 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:05:01,510 - lava_callback - INFO - Received callback for node 69bf07f8a85a0f2cbb32dbe8 INFO: 172.19.0.1:46314 - "POST /node/69bf07f8a85a0f2cbb32dbe8 HTTP/1.0" 202 Accepted 2026-03-23 21:05:01,519 - lava_callback - INFO - Starting async job submit for node 69bf07f8a85a0f2cbb32dbe8 2026-03-23 21:05:01,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:01,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf07f8a85a0f2cbb32dbe8 HTTP/1.1" 200 None 2026-03-23 21:05:01,535 - lava_callback - DEBUG - Processing node 69bf07f8a85a0f2cbb32dbe8: baseline-arm-baylibre 2026-03-23 21:05:01,536 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf07f8a85a0f2cbb32dbe8 2026-03-23 21:05:01,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:01,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf07f8a85a0f2cbb32dbe8 HTTP/1.1" 200 None 2026-03-23 21:05:01,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:01,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:05:01,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:01,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf07f8a85a0f2cbb32dbe8 HTTP/1.1" 200 None 2026-03-23 21:05:01,614 - lava_callback - ERROR - Error processing callback for node 69bf07f8a85a0f2cbb32dbe8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42586 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:05:41,570 - lava_callback - INFO - Received callback for node 69bf081ba85a0f2cbb32dbf8 INFO: 172.19.0.1:37032 - "POST /node/69bf081ba85a0f2cbb32dbf8 HTTP/1.0" 202 Accepted 2026-03-23 21:05:41,575 - lava_callback - INFO - Starting async job submit for node 69bf081ba85a0f2cbb32dbf8 2026-03-23 21:05:41,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:41,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf081ba85a0f2cbb32dbf8 HTTP/1.1" 200 None 2026-03-23 21:05:41,593 - lava_callback - DEBUG - Processing node 69bf081ba85a0f2cbb32dbf8: baseline-arm-baylibre 2026-03-23 21:05:41,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf081ba85a0f2cbb32dbf8 2026-03-23 21:05:41,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:41,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf081ba85a0f2cbb32dbf8 HTTP/1.1" 200 None 2026-03-23 21:05:41,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:41,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:05:41,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:05:41,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf081ba85a0f2cbb32dbf8 HTTP/1.1" 200 None 2026-03-23 21:05:41,676 - lava_callback - ERROR - Error processing callback for node 69bf081ba85a0f2cbb32dbf8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34204 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:06:21,545 - lava_callback - INFO - Received callback for node 69bf0840a85a0f2cbb32dc04 INFO: 172.19.0.1:40576 - "POST /node/69bf0840a85a0f2cbb32dc04 HTTP/1.0" 202 Accepted 2026-03-23 21:06:21,551 - lava_callback - INFO - Starting async job submit for node 69bf0840a85a0f2cbb32dc04 2026-03-23 21:06:21,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:06:21,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0840a85a0f2cbb32dc04 HTTP/1.1" 200 None 2026-03-23 21:06:21,568 - lava_callback - DEBUG - Processing node 69bf0840a85a0f2cbb32dc04: baseline-arm-baylibre 2026-03-23 21:06:21,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0840a85a0f2cbb32dc04 2026-03-23 21:06:21,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:06:21,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0840a85a0f2cbb32dc04 HTTP/1.1" 200 None 2026-03-23 21:06:21,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:06:21,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:06:21,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:06:21,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0840a85a0f2cbb32dc04 HTTP/1.1" 200 None 2026-03-23 21:06:21,634 - lava_callback - ERROR - Error processing callback for node 69bf0840a85a0f2cbb32dc04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56118 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:07:01,664 - lava_callback - INFO - Received callback for node 69bf0861a85a0f2cbb32dc0d INFO: 172.19.0.1:53008 - "POST /node/69bf0861a85a0f2cbb32dc0d HTTP/1.0" 202 Accepted 2026-03-23 21:07:01,669 - lava_callback - INFO - Starting async job submit for node 69bf0861a85a0f2cbb32dc0d 2026-03-23 21:07:01,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:01,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0861a85a0f2cbb32dc0d HTTP/1.1" 200 None 2026-03-23 21:07:01,685 - lava_callback - DEBUG - Processing node 69bf0861a85a0f2cbb32dc0d: baseline-arm-baylibre 2026-03-23 21:07:01,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0861a85a0f2cbb32dc0d 2026-03-23 21:07:01,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:01,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0861a85a0f2cbb32dc0d HTTP/1.1" 200 None 2026-03-23 21:07:01,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:01,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:07:01,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:01,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0861a85a0f2cbb32dc0d HTTP/1.1" 200 None 2026-03-23 21:07:01,753 - lava_callback - ERROR - Error processing callback for node 69bf0861a85a0f2cbb32dc0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45470 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45484 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:07:21,619 - lava_callback - INFO - Received callback for node 69bf0884a85a0f2cbb32dc1e INFO: 172.19.0.1:53026 - "POST /node/69bf0884a85a0f2cbb32dc1e HTTP/1.0" 202 Accepted 2026-03-23 21:07:21,624 - lava_callback - INFO - Starting async job submit for node 69bf0884a85a0f2cbb32dc1e 2026-03-23 21:07:21,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:21,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0884a85a0f2cbb32dc1e HTTP/1.1" 200 None 2026-03-23 21:07:21,662 - lava_callback - DEBUG - Processing node 69bf0884a85a0f2cbb32dc1e: baseline-arm-baylibre 2026-03-23 21:07:21,663 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0884a85a0f2cbb32dc1e 2026-03-23 21:07:21,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:21,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0884a85a0f2cbb32dc1e HTTP/1.1" 200 None 2026-03-23 21:07:21,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:21,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:07:21,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:07:21,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0884a85a0f2cbb32dc1e HTTP/1.1" 200 None 2026-03-23 21:07:21,721 - lava_callback - ERROR - Error processing callback for node 69bf0884a85a0f2cbb32dc1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43742 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:08:01,724 - lava_callback - INFO - Received callback for node 69bf08a8a85a0f2cbb32dc26 INFO: 172.19.0.1:47730 - "POST /node/69bf08a8a85a0f2cbb32dc26 HTTP/1.0" 202 Accepted 2026-03-23 21:08:01,730 - lava_callback - INFO - Starting async job submit for node 69bf08a8a85a0f2cbb32dc26 2026-03-23 21:08:01,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:01,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf08a8a85a0f2cbb32dc26 HTTP/1.1" 200 None 2026-03-23 21:08:01,746 - lava_callback - DEBUG - Processing node 69bf08a8a85a0f2cbb32dc26: baseline-arm-baylibre 2026-03-23 21:08:01,746 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf08a8a85a0f2cbb32dc26 2026-03-23 21:08:01,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:01,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf08a8a85a0f2cbb32dc26 HTTP/1.1" 200 None 2026-03-23 21:08:01,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:01,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:08:01,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:01,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf08a8a85a0f2cbb32dc26 HTTP/1.1" 200 None 2026-03-23 21:08:01,805 - lava_callback - ERROR - Error processing callback for node 69bf08a8a85a0f2cbb32dc26: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55784 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:08:19,898 - lava_callback - INFO - Received callback for node 69c186af2b2b51e9ad97ac9f INFO: 172.19.0.1:59450 - "POST /node/69c186af2b2b51e9ad97ac9f HTTP/1.0" 202 Accepted 2026-03-23 21:08:19,906 - lava_callback - INFO - Starting async job submit for node 69c186af2b2b51e9ad97ac9f 2026-03-23 21:08:19,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:19,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c186af2b2b51e9ad97ac9f HTTP/1.1" 200 None 2026-03-23 21:08:19,953 - lava_callback - DEBUG - Processing node 69c186af2b2b51e9ad97ac9f: baseline-arm64 2026-03-23 21:08:20,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 21:08:20,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 21:08:20,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c186af2b2b51e9ad97ac9f/log.txt.gz 2026-03-23 21:08:20,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 21:08:21,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 21:08:21,105 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c186af2b2b51e9ad97ac9f/lava-logs.yaml 2026-03-23 21:08:21,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 21:08:21,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 21:08:21,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c186af2b2b51e9ad97ac9f/lava_callback.json.gz 2026-03-23 21:08:21,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:21,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c186af2b2b51e9ad97ac9f HTTP/1.1" 200 None 2026-03-23 21:08:21,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:21,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 21:08:21,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:21,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c186af2b2b51e9ad97ac9f HTTP/1.1" 200 None 2026-03-23 21:08:21,451 - lava_callback - INFO - Completed processing callback for node 69c186af2b2b51e9ad97ac9f 2026-03-23 21:08:24,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:24,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56428 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:08:42,165 - lava_callback - INFO - Received callback for node 69bf08cba85a0f2cbb32dc35 INFO: 172.19.0.1:50248 - "POST /node/69bf08cba85a0f2cbb32dc35 HTTP/1.0" 202 Accepted 2026-03-23 21:08:42,171 - lava_callback - INFO - Starting async job submit for node 69bf08cba85a0f2cbb32dc35 2026-03-23 21:08:42,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:42,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf08cba85a0f2cbb32dc35 HTTP/1.1" 200 None 2026-03-23 21:08:42,188 - lava_callback - DEBUG - Processing node 69bf08cba85a0f2cbb32dc35: baseline-arm-baylibre 2026-03-23 21:08:42,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf08cba85a0f2cbb32dc35 2026-03-23 21:08:42,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:42,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf08cba85a0f2cbb32dc35 HTTP/1.1" 200 None 2026-03-23 21:08:42,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:42,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:08:42,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:08:42,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf08cba85a0f2cbb32dc35 HTTP/1.1" 200 None 2026-03-23 21:08:42,240 - lava_callback - ERROR - Error processing callback for node 69bf08cba85a0f2cbb32dc35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46178 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:09:25,924 - lava_callback - INFO - Received callback for node 69bf08faa85a0f2cbb32dc42 INFO: 172.19.0.1:54238 - "POST /node/69bf08faa85a0f2cbb32dc42 HTTP/1.0" 202 Accepted 2026-03-23 21:09:25,929 - lava_callback - INFO - Starting async job submit for node 69bf08faa85a0f2cbb32dc42 2026-03-23 21:09:25,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:09:25,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf08faa85a0f2cbb32dc42 HTTP/1.1" 200 None 2026-03-23 21:09:25,946 - lava_callback - DEBUG - Processing node 69bf08faa85a0f2cbb32dc42: baseline-arm-clabbe 2026-03-23 21:09:25,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf08faa85a0f2cbb32dc42 2026-03-23 21:09:25,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:09:25,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf08faa85a0f2cbb32dc42 HTTP/1.1" 200 None 2026-03-23 21:09:25,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:09:25,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:09:25,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:09:26,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf08faa85a0f2cbb32dc42 HTTP/1.1" 200 None 2026-03-23 21:09:26,012 - lava_callback - ERROR - Error processing callback for node 69bf08faa85a0f2cbb32dc42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45516 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:10:21,859 - lava_callback - INFO - Received callback for node 69bf0934a85a0f2cbb32dc53 INFO: 172.19.0.1:54802 - "POST /node/69bf0934a85a0f2cbb32dc53 HTTP/1.0" 202 Accepted 2026-03-23 21:10:21,864 - lava_callback - INFO - Starting async job submit for node 69bf0934a85a0f2cbb32dc53 2026-03-23 21:10:21,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:10:21,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0934a85a0f2cbb32dc53 HTTP/1.1" 200 None 2026-03-23 21:10:21,880 - lava_callback - DEBUG - Processing node 69bf0934a85a0f2cbb32dc53: baseline-arm-baylibre 2026-03-23 21:10:21,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0934a85a0f2cbb32dc53 2026-03-23 21:10:21,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:10:21,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0934a85a0f2cbb32dc53 HTTP/1.1" 200 None 2026-03-23 21:10:21,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:10:21,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:10:21,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:10:21,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0934a85a0f2cbb32dc53 HTTP/1.1" 200 None 2026-03-23 21:10:21,944 - lava_callback - ERROR - Error processing callback for node 69bf0934a85a0f2cbb32dc53: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51302 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:11:06,001 - lava_callback - INFO - Received callback for node 69bf0958a85a0f2cbb32dc60 INFO: 172.19.0.1:51316 - "POST /node/69bf0958a85a0f2cbb32dc60 HTTP/1.0" 202 Accepted 2026-03-23 21:11:06,007 - lava_callback - INFO - Starting async job submit for node 69bf0958a85a0f2cbb32dc60 2026-03-23 21:11:06,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:06,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0958a85a0f2cbb32dc60 HTTP/1.1" 200 None 2026-03-23 21:11:06,024 - lava_callback - DEBUG - Processing node 69bf0958a85a0f2cbb32dc60: baseline-arm-clabbe 2026-03-23 21:11:06,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0958a85a0f2cbb32dc60 2026-03-23 21:11:06,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:06,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0958a85a0f2cbb32dc60 HTTP/1.1" 200 None 2026-03-23 21:11:06,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:06,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:11:06,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:06,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0958a85a0f2cbb32dc60 HTTP/1.1" 200 None 2026-03-23 21:11:06,093 - lava_callback - ERROR - Error processing callback for node 69bf0958a85a0f2cbb32dc60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45796 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:11:45,989 - lava_callback - INFO - Received callback for node 69bf097ca85a0f2cbb32dc70 INFO: 172.19.0.1:45682 - "POST /node/69bf097ca85a0f2cbb32dc70 HTTP/1.0" 202 Accepted 2026-03-23 21:11:45,995 - lava_callback - INFO - Starting async job submit for node 69bf097ca85a0f2cbb32dc70 2026-03-23 21:11:45,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:46,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf097ca85a0f2cbb32dc70 HTTP/1.1" 200 None 2026-03-23 21:11:46,013 - lava_callback - DEBUG - Processing node 69bf097ca85a0f2cbb32dc70: baseline-arm-clabbe 2026-03-23 21:11:46,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf097ca85a0f2cbb32dc70 2026-03-23 21:11:46,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:46,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf097ca85a0f2cbb32dc70 HTTP/1.1" 200 None 2026-03-23 21:11:46,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:46,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:11:46,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:11:46,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf097ca85a0f2cbb32dc70 HTTP/1.1" 200 None 2026-03-23 21:11:46,093 - lava_callback - ERROR - Error processing callback for node 69bf097ca85a0f2cbb32dc70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38130 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:12:06,025 - lava_callback - INFO - Received callback for node 69bf099fa85a0f2cbb32dc7c INFO: 172.19.0.1:38132 - "POST /node/69bf099fa85a0f2cbb32dc7c HTTP/1.0" 202 Accepted 2026-03-23 21:12:06,031 - lava_callback - INFO - Starting async job submit for node 69bf099fa85a0f2cbb32dc7c 2026-03-23 21:12:06,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:06,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf099fa85a0f2cbb32dc7c HTTP/1.1" 200 None 2026-03-23 21:12:06,047 - lava_callback - DEBUG - Processing node 69bf099fa85a0f2cbb32dc7c: baseline-arm-clabbe 2026-03-23 21:12:06,047 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf099fa85a0f2cbb32dc7c 2026-03-23 21:12:06,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:06,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf099fa85a0f2cbb32dc7c HTTP/1.1" 200 None 2026-03-23 21:12:06,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:06,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:12:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:06,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf099fa85a0f2cbb32dc7c HTTP/1.1" 200 None 2026-03-23 21:12:06,115 - lava_callback - ERROR - Error processing callback for node 69bf099fa85a0f2cbb32dc7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33552 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:12:46,030 - lava_callback - INFO - Received callback for node 69bf09c3a85a0f2cbb32dc8b INFO: 172.19.0.1:59032 - "POST /node/69bf09c3a85a0f2cbb32dc8b HTTP/1.0" 202 Accepted 2026-03-23 21:12:46,035 - lava_callback - INFO - Starting async job submit for node 69bf09c3a85a0f2cbb32dc8b 2026-03-23 21:12:46,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:46,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf09c3a85a0f2cbb32dc8b HTTP/1.1" 200 None 2026-03-23 21:12:46,052 - lava_callback - DEBUG - Processing node 69bf09c3a85a0f2cbb32dc8b: baseline-arm-clabbe 2026-03-23 21:12:46,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf09c3a85a0f2cbb32dc8b 2026-03-23 21:12:46,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:46,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf09c3a85a0f2cbb32dc8b HTTP/1.1" 200 None 2026-03-23 21:12:46,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:46,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:12:46,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:12:46,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf09c3a85a0f2cbb32dc8b HTTP/1.1" 200 None 2026-03-23 21:12:46,108 - lava_callback - ERROR - Error processing callback for node 69bf09c3a85a0f2cbb32dc8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47800 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:13:26,082 - lava_callback - INFO - Received callback for node 69bf09eaa85a0f2cbb32dc9d INFO: 172.19.0.1:37744 - "POST /node/69bf09eaa85a0f2cbb32dc9d HTTP/1.0" 202 Accepted 2026-03-23 21:13:26,087 - lava_callback - INFO - Starting async job submit for node 69bf09eaa85a0f2cbb32dc9d 2026-03-23 21:13:26,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:13:26,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf09eaa85a0f2cbb32dc9d HTTP/1.1" 200 None 2026-03-23 21:13:26,104 - lava_callback - DEBUG - Processing node 69bf09eaa85a0f2cbb32dc9d: baseline-arm-clabbe 2026-03-23 21:13:26,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf09eaa85a0f2cbb32dc9d 2026-03-23 21:13:26,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:13:26,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf09eaa85a0f2cbb32dc9d HTTP/1.1" 200 None 2026-03-23 21:13:26,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:13:26,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:13:26,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:13:26,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf09eaa85a0f2cbb32dc9d HTTP/1.1" 200 None 2026-03-23 21:13:26,203 - lava_callback - ERROR - Error processing callback for node 69bf09eaa85a0f2cbb32dc9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59188 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:14:06,044 - lava_callback - INFO - Received callback for node 69bf0a0ea85a0f2cbb32dcab INFO: 172.19.0.1:59196 - "POST /node/69bf0a0ea85a0f2cbb32dcab HTTP/1.0" 202 Accepted 2026-03-23 21:14:06,050 - lava_callback - INFO - Starting async job submit for node 69bf0a0ea85a0f2cbb32dcab 2026-03-23 21:14:06,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:06,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a0ea85a0f2cbb32dcab HTTP/1.1" 200 None 2026-03-23 21:14:06,070 - lava_callback - DEBUG - Processing node 69bf0a0ea85a0f2cbb32dcab: baseline-arm-clabbe 2026-03-23 21:14:06,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0a0ea85a0f2cbb32dcab 2026-03-23 21:14:06,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:06,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a0ea85a0f2cbb32dcab HTTP/1.1" 200 None 2026-03-23 21:14:06,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:06,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:14:06,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:06,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0a0ea85a0f2cbb32dcab HTTP/1.1" 200 None 2026-03-23 21:14:06,129 - lava_callback - ERROR - Error processing callback for node 69bf0a0ea85a0f2cbb32dcab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58706 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:14:46,169 - lava_callback - INFO - Received callback for node 69bf0a33a85a0f2cbb32dcbb INFO: 172.19.0.1:46644 - "POST /node/69bf0a33a85a0f2cbb32dcbb HTTP/1.0" 202 Accepted 2026-03-23 21:14:46,175 - lava_callback - INFO - Starting async job submit for node 69bf0a33a85a0f2cbb32dcbb 2026-03-23 21:14:46,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:46,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a33a85a0f2cbb32dcbb HTTP/1.1" 200 None 2026-03-23 21:14:46,191 - lava_callback - DEBUG - Processing node 69bf0a33a85a0f2cbb32dcbb: baseline-arm-clabbe 2026-03-23 21:14:46,191 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0a33a85a0f2cbb32dcbb 2026-03-23 21:14:46,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:46,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a33a85a0f2cbb32dcbb HTTP/1.1" 200 None 2026-03-23 21:14:46,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:46,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:14:46,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:14:46,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0a33a85a0f2cbb32dcbb HTTP/1.1" 200 None 2026-03-23 21:14:46,268 - lava_callback - ERROR - Error processing callback for node 69bf0a33a85a0f2cbb32dcbb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34494 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:15:06,274 - lava_callback - INFO - Received callback for node 69bf0a57a85a0f2cbb32dcc7 INFO: 172.19.0.1:34498 - "POST /node/69bf0a57a85a0f2cbb32dcc7 HTTP/1.0" 202 Accepted 2026-03-23 21:15:06,280 - lava_callback - INFO - Starting async job submit for node 69bf0a57a85a0f2cbb32dcc7 2026-03-23 21:15:06,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:06,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a57a85a0f2cbb32dcc7 HTTP/1.1" 200 None 2026-03-23 21:15:06,295 - lava_callback - DEBUG - Processing node 69bf0a57a85a0f2cbb32dcc7: baseline-arm-clabbe 2026-03-23 21:15:06,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0a57a85a0f2cbb32dcc7 2026-03-23 21:15:06,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:06,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a57a85a0f2cbb32dcc7 HTTP/1.1" 200 None 2026-03-23 21:15:06,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:06,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:15:06,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:06,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0a57a85a0f2cbb32dcc7 HTTP/1.1" 200 None 2026-03-23 21:15:06,370 - lava_callback - ERROR - Error processing callback for node 69bf0a57a85a0f2cbb32dcc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44036 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:15:46,185 - lava_callback - INFO - Received callback for node 69bf0a7ba85a0f2cbb32dcd6 INFO: 172.19.0.1:40130 - "POST /node/69bf0a7ba85a0f2cbb32dcd6 HTTP/1.0" 202 Accepted 2026-03-23 21:15:46,191 - lava_callback - INFO - Starting async job submit for node 69bf0a7ba85a0f2cbb32dcd6 2026-03-23 21:15:46,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:46,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a7ba85a0f2cbb32dcd6 HTTP/1.1" 200 None 2026-03-23 21:15:46,209 - lava_callback - DEBUG - Processing node 69bf0a7ba85a0f2cbb32dcd6: baseline-arm-clabbe 2026-03-23 21:15:46,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0a7ba85a0f2cbb32dcd6 2026-03-23 21:15:46,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:46,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0a7ba85a0f2cbb32dcd6 HTTP/1.1" 200 None 2026-03-23 21:15:46,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:46,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-23 21:15:46,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:46,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0a7ba85a0f2cbb32dcd6 HTTP/1.1" 200 None 2026-03-23 21:15:46,263 - lava_callback - ERROR - Error processing callback for node 69bf0a7ba85a0f2cbb32dcd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40132 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:15:48,212 - lava_callback - INFO - Received callback for node 69c1870b2b2b51e9ad97acbe INFO: 172.19.0.1:40144 - "POST /node/69c1870b2b2b51e9ad97acbe HTTP/1.0" 202 Accepted 2026-03-23 21:15:48,218 - lava_callback - INFO - Starting async job submit for node 69c1870b2b2b51e9ad97acbe 2026-03-23 21:15:48,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:48,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1870b2b2b51e9ad97acbe HTTP/1.1" 200 None 2026-03-23 21:15:48,259 - lava_callback - DEBUG - Processing node 69c1870b2b2b51e9ad97acbe: baseline-nfs-arm64 2026-03-23 21:15:48,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 21:15:48,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 21:15:48,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1870b2b2b51e9ad97acbe/log.txt.gz 2026-03-23 21:15:49,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 21:15:49,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 21:15:49,405 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1870b2b2b51e9ad97acbe/lava-logs.yaml 2026-03-23 21:15:49,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 21:15:49,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 21:15:49,623 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1870b2b2b51e9ad97acbe/lava_callback.json.gz 2026-03-23 21:15:49,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:49,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1870b2b2b51e9ad97acbe HTTP/1.1" 200 None 2026-03-23 21:15:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:49,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 21:15:49,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:49,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1870b2b2b51e9ad97acbe HTTP/1.1" 200 None 2026-03-23 21:15:49,779 - lava_callback - INFO - Completed processing callback for node 69c1870b2b2b51e9ad97acbe 2026-03-23 21:15:54,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:15:54,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55746 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:18:42,282 - lava_callback - INFO - Received callback for node 69bf0b22a85a0f2cbb32dd00 INFO: 172.19.0.1:48456 - "POST /node/69bf0b22a85a0f2cbb32dd00 HTTP/1.0" 202 Accepted 2026-03-23 21:18:42,288 - lava_callback - INFO - Starting async job submit for node 69bf0b22a85a0f2cbb32dd00 2026-03-23 21:18:42,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:18:42,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0b22a85a0f2cbb32dd00 HTTP/1.1" 200 None 2026-03-23 21:18:42,304 - lava_callback - DEBUG - Processing node 69bf0b22a85a0f2cbb32dd00: baseline-arm64-baylibre 2026-03-23 21:18:42,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0b22a85a0f2cbb32dd00 2026-03-23 21:18:42,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:18:42,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0b22a85a0f2cbb32dd00 HTTP/1.1" 200 None 2026-03-23 21:18:42,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:18:42,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:18:42,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:18:42,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0b22a85a0f2cbb32dd00 HTTP/1.1" 200 None 2026-03-23 21:18:42,357 - lava_callback - ERROR - Error processing callback for node 69bf0b22a85a0f2cbb32dd00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50850 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:20:02,260 - lava_callback - INFO - Received callback for node 69bf0b6ea85a0f2cbb32dd0d INFO: 172.19.0.1:33624 - "POST /node/69bf0b6ea85a0f2cbb32dd0d HTTP/1.0" 202 Accepted 2026-03-23 21:20:02,265 - lava_callback - INFO - Starting async job submit for node 69bf0b6ea85a0f2cbb32dd0d 2026-03-23 21:20:02,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:20:02,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0b6ea85a0f2cbb32dd0d HTTP/1.1" 200 None 2026-03-23 21:20:02,282 - lava_callback - DEBUG - Processing node 69bf0b6ea85a0f2cbb32dd0d: baseline-arm64-baylibre 2026-03-23 21:20:02,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0b6ea85a0f2cbb32dd0d 2026-03-23 21:20:02,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:20:02,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0b6ea85a0f2cbb32dd0d HTTP/1.1" 200 None 2026-03-23 21:20:02,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:20:02,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:20:02,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:20:02,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0b6ea85a0f2cbb32dd0d HTTP/1.1" 200 None 2026-03-23 21:20:02,339 - lava_callback - ERROR - Error processing callback for node 69bf0b6ea85a0f2cbb32dd0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55432 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:21:02,227 - lava_callback - INFO - Received callback for node 69bf0bb8a85a0f2cbb32dd1e INFO: 172.19.0.1:35968 - "POST /node/69bf0bb8a85a0f2cbb32dd1e HTTP/1.0" 202 Accepted 2026-03-23 21:21:02,233 - lava_callback - INFO - Starting async job submit for node 69bf0bb8a85a0f2cbb32dd1e 2026-03-23 21:21:02,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:21:02,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0bb8a85a0f2cbb32dd1e HTTP/1.1" 200 None 2026-03-23 21:21:02,249 - lava_callback - DEBUG - Processing node 69bf0bb8a85a0f2cbb32dd1e: baseline-arm64-baylibre 2026-03-23 21:21:02,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0bb8a85a0f2cbb32dd1e 2026-03-23 21:21:02,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:21:02,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0bb8a85a0f2cbb32dd1e HTTP/1.1" 200 None 2026-03-23 21:21:02,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:21:02,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:21:02,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:21:02,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0bb8a85a0f2cbb32dd1e HTTP/1.1" 200 None 2026-03-23 21:21:02,328 - lava_callback - ERROR - Error processing callback for node 69bf0bb8a85a0f2cbb32dd1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55258 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:22:22,542 - lava_callback - INFO - Received callback for node 69bf0bffa85a0f2cbb32dd2a INFO: 172.19.0.1:33100 - "POST /node/69bf0bffa85a0f2cbb32dd2a HTTP/1.0" 202 Accepted 2026-03-23 21:22:22,548 - lava_callback - INFO - Starting async job submit for node 69bf0bffa85a0f2cbb32dd2a 2026-03-23 21:22:22,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:22:22,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0bffa85a0f2cbb32dd2a HTTP/1.1" 200 None 2026-03-23 21:22:22,564 - lava_callback - DEBUG - Processing node 69bf0bffa85a0f2cbb32dd2a: baseline-arm64-baylibre 2026-03-23 21:22:22,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0bffa85a0f2cbb32dd2a 2026-03-23 21:22:22,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:22:22,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0bffa85a0f2cbb32dd2a HTTP/1.1" 200 None 2026-03-23 21:22:22,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:22:22,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:22:22,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:22:22,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0bffa85a0f2cbb32dd2a HTTP/1.1" 200 None 2026-03-23 21:22:22,627 - lava_callback - ERROR - Error processing callback for node 69bf0bffa85a0f2cbb32dd2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39896 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:23:42,428 - lava_callback - INFO - Received callback for node 69bf0c4aa85a0f2cbb32dd38 INFO: 172.19.0.1:48226 - "POST /node/69bf0c4aa85a0f2cbb32dd38 HTTP/1.0" 202 Accepted 2026-03-23 21:23:42,434 - lava_callback - INFO - Starting async job submit for node 69bf0c4aa85a0f2cbb32dd38 2026-03-23 21:23:42,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:23:42,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0c4aa85a0f2cbb32dd38 HTTP/1.1" 200 None 2026-03-23 21:23:42,450 - lava_callback - DEBUG - Processing node 69bf0c4aa85a0f2cbb32dd38: baseline-arm64-baylibre 2026-03-23 21:23:42,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0c4aa85a0f2cbb32dd38 2026-03-23 21:23:42,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:23:42,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0c4aa85a0f2cbb32dd38 HTTP/1.1" 200 None 2026-03-23 21:23:42,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:23:42,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:23:42,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:23:42,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0c4aa85a0f2cbb32dd38 HTTP/1.1" 200 None 2026-03-23 21:23:42,501 - lava_callback - ERROR - Error processing callback for node 69bf0c4aa85a0f2cbb32dd38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38616 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:24:42,449 - lava_callback - INFO - Received callback for node 69bf0c94a85a0f2cbb32dd44 INFO: 172.19.0.1:55568 - "POST /node/69bf0c94a85a0f2cbb32dd44 HTTP/1.0" 202 Accepted 2026-03-23 21:24:42,454 - lava_callback - INFO - Starting async job submit for node 69bf0c94a85a0f2cbb32dd44 2026-03-23 21:24:42,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:24:42,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0c94a85a0f2cbb32dd44 HTTP/1.1" 200 None 2026-03-23 21:24:42,471 - lava_callback - DEBUG - Processing node 69bf0c94a85a0f2cbb32dd44: baseline-arm64-baylibre 2026-03-23 21:24:42,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0c94a85a0f2cbb32dd44 2026-03-23 21:24:42,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:24:42,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0c94a85a0f2cbb32dd44 HTTP/1.1" 200 None 2026-03-23 21:24:42,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:24:42,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:24:42,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:24:42,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0c94a85a0f2cbb32dd44 HTTP/1.1" 200 None 2026-03-23 21:24:42,541 - lava_callback - ERROR - Error processing callback for node 69bf0c94a85a0f2cbb32dd44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40228 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:26:02,668 - lava_callback - INFO - Received callback for node 69bf0cdca85a0f2cbb32dd56 INFO: 172.19.0.1:42550 - "POST /node/69bf0cdca85a0f2cbb32dd56 HTTP/1.0" 202 Accepted 2026-03-23 21:26:02,674 - lava_callback - INFO - Starting async job submit for node 69bf0cdca85a0f2cbb32dd56 2026-03-23 21:26:02,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:26:02,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0cdca85a0f2cbb32dd56 HTTP/1.1" 200 None 2026-03-23 21:26:02,690 - lava_callback - DEBUG - Processing node 69bf0cdca85a0f2cbb32dd56: baseline-arm64-baylibre 2026-03-23 21:26:02,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0cdca85a0f2cbb32dd56 2026-03-23 21:26:02,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:26:02,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0cdca85a0f2cbb32dd56 HTTP/1.1" 200 None 2026-03-23 21:26:02,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:26:02,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:26:02,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:26:02,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0cdca85a0f2cbb32dd56 HTTP/1.1" 200 None 2026-03-23 21:26:02,741 - lava_callback - ERROR - Error processing callback for node 69bf0cdca85a0f2cbb32dd56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48022 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:27:22,814 - lava_callback - INFO - Received callback for node 69bf0d28a85a0f2cbb32dd62 INFO: 172.19.0.1:59904 - "POST /node/69bf0d28a85a0f2cbb32dd62 HTTP/1.0" 202 Accepted 2026-03-23 21:27:22,820 - lava_callback - INFO - Starting async job submit for node 69bf0d28a85a0f2cbb32dd62 2026-03-23 21:27:22,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:27:22,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0d28a85a0f2cbb32dd62 HTTP/1.1" 200 None 2026-03-23 21:27:22,844 - lava_callback - DEBUG - Processing node 69bf0d28a85a0f2cbb32dd62: baseline-arm64-baylibre 2026-03-23 21:27:22,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0d28a85a0f2cbb32dd62 2026-03-23 21:27:22,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:27:22,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0d28a85a0f2cbb32dd62 HTTP/1.1" 200 None 2026-03-23 21:27:22,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:27:22,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:27:22,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:27:22,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0d28a85a0f2cbb32dd62 HTTP/1.1" 200 None 2026-03-23 21:27:22,904 - lava_callback - ERROR - Error processing callback for node 69bf0d28a85a0f2cbb32dd62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58160 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:28:46,702 - lava_callback - INFO - Received callback for node 69bf0d78a85a0f2cbb32dd72 INFO: 172.19.0.1:58166 - "POST /node/69bf0d78a85a0f2cbb32dd72 HTTP/1.0" 202 Accepted 2026-03-23 21:28:46,708 - lava_callback - INFO - Starting async job submit for node 69bf0d78a85a0f2cbb32dd72 2026-03-23 21:28:46,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:28:46,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0d78a85a0f2cbb32dd72 HTTP/1.1" 200 None 2026-03-23 21:28:46,724 - lava_callback - DEBUG - Processing node 69bf0d78a85a0f2cbb32dd72: baseline-arm64-clabbe 2026-03-23 21:28:46,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0d78a85a0f2cbb32dd72 2026-03-23 21:28:46,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:28:46,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0d78a85a0f2cbb32dd72 HTTP/1.1" 200 None 2026-03-23 21:28:46,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:28:46,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:28:46,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:28:46,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0d78a85a0f2cbb32dd72 HTTP/1.1" 200 None 2026-03-23 21:28:46,776 - lava_callback - ERROR - Error processing callback for node 69bf0d78a85a0f2cbb32dd72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59490 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:29:46,730 - lava_callback - INFO - Received callback for node 69bf0dc2a85a0f2cbb32dd7e INFO: 172.19.0.1:59506 - "POST /node/69bf0dc2a85a0f2cbb32dd7e HTTP/1.0" 202 Accepted 2026-03-23 21:29:46,736 - lava_callback - INFO - Starting async job submit for node 69bf0dc2a85a0f2cbb32dd7e 2026-03-23 21:29:46,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:29:46,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0dc2a85a0f2cbb32dd7e HTTP/1.1" 200 None 2026-03-23 21:29:46,752 - lava_callback - DEBUG - Processing node 69bf0dc2a85a0f2cbb32dd7e: baseline-arm64-clabbe 2026-03-23 21:29:46,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0dc2a85a0f2cbb32dd7e 2026-03-23 21:29:46,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:29:46,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0dc2a85a0f2cbb32dd7e HTTP/1.1" 200 None 2026-03-23 21:29:46,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:29:46,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:29:46,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:29:46,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0dc2a85a0f2cbb32dd7e HTTP/1.1" 200 None 2026-03-23 21:29:46,828 - lava_callback - ERROR - Error processing callback for node 69bf0dc2a85a0f2cbb32dd7e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40924 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:32:26,815 - lava_callback - INFO - Received callback for node 69bf0e56a85a0f2cbb32dd99 INFO: 172.19.0.1:40926 - "POST /node/69bf0e56a85a0f2cbb32dd99 HTTP/1.0" 202 Accepted 2026-03-23 21:32:26,820 - lava_callback - INFO - Starting async job submit for node 69bf0e56a85a0f2cbb32dd99 2026-03-23 21:32:26,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:32:26,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0e56a85a0f2cbb32dd99 HTTP/1.1" 200 None 2026-03-23 21:32:26,837 - lava_callback - DEBUG - Processing node 69bf0e56a85a0f2cbb32dd99: baseline-arm64-clabbe 2026-03-23 21:32:26,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0e56a85a0f2cbb32dd99 2026-03-23 21:32:26,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:32:26,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0e56a85a0f2cbb32dd99 HTTP/1.1" 200 None 2026-03-23 21:32:26,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:32:26,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:32:26,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:32:26,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0e56a85a0f2cbb32dd99 HTTP/1.1" 200 None 2026-03-23 21:32:26,889 - lava_callback - ERROR - Error processing callback for node 69bf0e56a85a0f2cbb32dd99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48900 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:33:26,888 - lava_callback - INFO - Received callback for node 69bf0ea1a85a0f2cbb32ddaa INFO: 172.19.0.1:48912 - "POST /node/69bf0ea1a85a0f2cbb32ddaa HTTP/1.0" 202 Accepted 2026-03-23 21:33:26,894 - lava_callback - INFO - Starting async job submit for node 69bf0ea1a85a0f2cbb32ddaa 2026-03-23 21:33:26,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:33:26,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0ea1a85a0f2cbb32ddaa HTTP/1.1" 200 None 2026-03-23 21:33:26,909 - lava_callback - DEBUG - Processing node 69bf0ea1a85a0f2cbb32ddaa: baseline-arm64-clabbe 2026-03-23 21:33:26,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0ea1a85a0f2cbb32ddaa 2026-03-23 21:33:26,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:33:26,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0ea1a85a0f2cbb32ddaa HTTP/1.1" 200 None 2026-03-23 21:33:26,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:33:26,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:33:26,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:33:26,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0ea1a85a0f2cbb32ddaa HTTP/1.1" 200 None 2026-03-23 21:33:26,967 - lava_callback - ERROR - Error processing callback for node 69bf0ea1a85a0f2cbb32ddaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44696 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:34:46,975 - lava_callback - INFO - Received callback for node 69bf0eeba85a0f2cbb32ddb5 INFO: 172.19.0.1:44708 - "POST /node/69bf0eeba85a0f2cbb32ddb5 HTTP/1.0" 202 Accepted 2026-03-23 21:34:46,980 - lava_callback - INFO - Starting async job submit for node 69bf0eeba85a0f2cbb32ddb5 2026-03-23 21:34:46,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:34:47,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0eeba85a0f2cbb32ddb5 HTTP/1.1" 200 None 2026-03-23 21:34:47,001 - lava_callback - DEBUG - Processing node 69bf0eeba85a0f2cbb32ddb5: baseline-arm64-clabbe 2026-03-23 21:34:47,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0eeba85a0f2cbb32ddb5 2026-03-23 21:34:47,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:34:47,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0eeba85a0f2cbb32ddb5 HTTP/1.1" 200 None 2026-03-23 21:34:47,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:34:47,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:34:47,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:34:47,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0eeba85a0f2cbb32ddb5 HTTP/1.1" 200 None 2026-03-23 21:34:47,058 - lava_callback - ERROR - Error processing callback for node 69bf0eeba85a0f2cbb32ddb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48914 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:36:06,985 - lava_callback - INFO - Received callback for node 69bf0f36a85a0f2cbb32ddc6 INFO: 172.19.0.1:48926 - "POST /node/69bf0f36a85a0f2cbb32ddc6 HTTP/1.0" 202 Accepted 2026-03-23 21:36:06,991 - lava_callback - INFO - Starting async job submit for node 69bf0f36a85a0f2cbb32ddc6 2026-03-23 21:36:06,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:36:07,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0f36a85a0f2cbb32ddc6 HTTP/1.1" 200 None 2026-03-23 21:36:07,044 - lava_callback - DEBUG - Processing node 69bf0f36a85a0f2cbb32ddc6: baseline-arm64-clabbe 2026-03-23 21:36:07,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0f36a85a0f2cbb32ddc6 2026-03-23 21:36:07,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:36:07,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0f36a85a0f2cbb32ddc6 HTTP/1.1" 200 None 2026-03-23 21:36:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:36:07,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:36:07,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:36:07,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0f36a85a0f2cbb32ddc6 HTTP/1.1" 200 None 2026-03-23 21:36:07,098 - lava_callback - ERROR - Error processing callback for node 69bf0f36a85a0f2cbb32ddc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44850 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:37:03,602 - lava_callback - INFO - Received callback for node 69bf0f79a85a0f2cbb32ddd0 INFO: 172.19.0.1:48618 - "POST /node/69bf0f79a85a0f2cbb32ddd0 HTTP/1.0" 202 Accepted 2026-03-23 21:37:03,607 - lava_callback - INFO - Starting async job submit for node 69bf0f79a85a0f2cbb32ddd0 2026-03-23 21:37:03,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:37:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0f79a85a0f2cbb32ddd0 HTTP/1.1" 200 None 2026-03-23 21:37:03,624 - lava_callback - DEBUG - Processing node 69bf0f79a85a0f2cbb32ddd0: baseline-arm64-baylibre 2026-03-23 21:37:03,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0f79a85a0f2cbb32ddd0 2026-03-23 21:37:03,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:37:03,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0f79a85a0f2cbb32ddd0 HTTP/1.1" 200 None 2026-03-23 21:37:03,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:37:03,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:37:03,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:37:03,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0f79a85a0f2cbb32ddd0 HTTP/1.1" 200 None 2026-03-23 21:37:03,680 - lava_callback - ERROR - Error processing callback for node 69bf0f79a85a0f2cbb32ddd0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56478 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:38:27,112 - lava_callback - INFO - Received callback for node 69bf0fcaa85a0f2cbb32dde1 INFO: 172.19.0.1:56494 - "POST /node/69bf0fcaa85a0f2cbb32dde1 HTTP/1.0" 202 Accepted 2026-03-23 21:38:27,117 - lava_callback - INFO - Starting async job submit for node 69bf0fcaa85a0f2cbb32dde1 2026-03-23 21:38:27,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:38:27,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0fcaa85a0f2cbb32dde1 HTTP/1.1" 200 None 2026-03-23 21:38:27,134 - lava_callback - DEBUG - Processing node 69bf0fcaa85a0f2cbb32dde1: baseline-arm64-clabbe 2026-03-23 21:38:27,134 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf0fcaa85a0f2cbb32dde1 2026-03-23 21:38:27,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:38:27,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf0fcaa85a0f2cbb32dde1 HTTP/1.1" 200 None 2026-03-23 21:38:27,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:38:27,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:38:27,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:38:27,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf0fcaa85a0f2cbb32dde1 HTTP/1.1" 200 None 2026-03-23 21:38:27,188 - lava_callback - ERROR - Error processing callback for node 69bf0fcaa85a0f2cbb32dde1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54716 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:39:47,140 - lava_callback - INFO - Received callback for node 69bf1013a85a0f2cbb32ddec INFO: 172.19.0.1:54730 - "POST /node/69bf1013a85a0f2cbb32ddec HTTP/1.0" 202 Accepted 2026-03-23 21:39:47,145 - lava_callback - INFO - Starting async job submit for node 69bf1013a85a0f2cbb32ddec 2026-03-23 21:39:47,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:39:47,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1013a85a0f2cbb32ddec HTTP/1.1" 200 None 2026-03-23 21:39:47,162 - lava_callback - DEBUG - Processing node 69bf1013a85a0f2cbb32ddec: baseline-arm64-clabbe 2026-03-23 21:39:47,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1013a85a0f2cbb32ddec 2026-03-23 21:39:47,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:39:47,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1013a85a0f2cbb32ddec HTTP/1.1" 200 None 2026-03-23 21:39:47,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:39:47,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:39:47,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:39:47,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1013a85a0f2cbb32ddec HTTP/1.1" 200 None 2026-03-23 21:39:47,242 - lava_callback - ERROR - Error processing callback for node 69bf1013a85a0f2cbb32ddec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51110 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:41:07,180 - lava_callback - INFO - Received callback for node 69bf105da85a0f2cbb32ddf8 INFO: 172.19.0.1:51124 - "POST /node/69bf105da85a0f2cbb32ddf8 HTTP/1.0" 202 Accepted 2026-03-23 21:41:07,186 - lava_callback - INFO - Starting async job submit for node 69bf105da85a0f2cbb32ddf8 2026-03-23 21:41:07,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:41:07,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf105da85a0f2cbb32ddf8 HTTP/1.1" 200 None 2026-03-23 21:41:07,203 - lava_callback - DEBUG - Processing node 69bf105da85a0f2cbb32ddf8: baseline-arm64-clabbe 2026-03-23 21:41:07,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf105da85a0f2cbb32ddf8 2026-03-23 21:41:07,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:41:07,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf105da85a0f2cbb32ddf8 HTTP/1.1" 200 None 2026-03-23 21:41:07,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:41:07,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:41:07,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:41:07,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf105da85a0f2cbb32ddf8 HTTP/1.1" 200 None 2026-03-23 21:41:07,259 - lava_callback - ERROR - Error processing callback for node 69bf105da85a0f2cbb32ddf8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47472 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:42:03,343 - lava_callback - INFO - Received callback for node 69bf10a3a85a0f2cbb32de06 INFO: 172.19.0.1:32992 - "POST /node/69bf10a3a85a0f2cbb32de06 HTTP/1.0" 202 Accepted 2026-03-23 21:42:03,349 - lava_callback - INFO - Starting async job submit for node 69bf10a3a85a0f2cbb32de06 2026-03-23 21:42:03,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:42:03,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf10a3a85a0f2cbb32de06 HTTP/1.1" 200 None 2026-03-23 21:42:03,390 - lava_callback - DEBUG - Processing node 69bf10a3a85a0f2cbb32de06: baseline-arm64-baylibre 2026-03-23 21:42:03,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf10a3a85a0f2cbb32de06 2026-03-23 21:42:03,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:42:03,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf10a3a85a0f2cbb32de06 HTTP/1.1" 200 None 2026-03-23 21:42:03,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:42:03,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:42:03,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:42:03,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf10a3a85a0f2cbb32de06 HTTP/1.1" 200 None 2026-03-23 21:42:03,470 - lava_callback - ERROR - Error processing callback for node 69bf10a3a85a0f2cbb32de06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47518 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:43:27,323 - lava_callback - INFO - Received callback for node 69bf10f5a85a0f2cbb32de18 INFO: 172.19.0.1:47530 - "POST /node/69bf10f5a85a0f2cbb32de18 HTTP/1.0" 202 Accepted 2026-03-23 21:43:27,328 - lava_callback - INFO - Starting async job submit for node 69bf10f5a85a0f2cbb32de18 2026-03-23 21:43:27,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:43:27,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf10f5a85a0f2cbb32de18 HTTP/1.1" 200 None 2026-03-23 21:43:27,348 - lava_callback - DEBUG - Processing node 69bf10f5a85a0f2cbb32de18: baseline-arm64-clabbe 2026-03-23 21:43:27,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf10f5a85a0f2cbb32de18 2026-03-23 21:43:27,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:43:27,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf10f5a85a0f2cbb32de18 HTTP/1.1" 200 None 2026-03-23 21:43:27,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:43:27,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:43:27,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:43:27,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf10f5a85a0f2cbb32de18 HTTP/1.1" 200 None 2026-03-23 21:43:27,424 - lava_callback - ERROR - Error processing callback for node 69bf10f5a85a0f2cbb32de18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58306 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:44:47,353 - lava_callback - INFO - Received callback for node 69bf1141a85a0f2cbb32de20 INFO: 172.19.0.1:58312 - "POST /node/69bf1141a85a0f2cbb32de20 HTTP/1.0" 202 Accepted 2026-03-23 21:44:47,358 - lava_callback - INFO - Starting async job submit for node 69bf1141a85a0f2cbb32de20 2026-03-23 21:44:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:44:47,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1141a85a0f2cbb32de20 HTTP/1.1" 200 None 2026-03-23 21:44:47,375 - lava_callback - DEBUG - Processing node 69bf1141a85a0f2cbb32de20: baseline-arm64-clabbe 2026-03-23 21:44:47,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1141a85a0f2cbb32de20 2026-03-23 21:44:47,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:44:47,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1141a85a0f2cbb32de20 HTTP/1.1" 200 None 2026-03-23 21:44:47,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:44:47,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:44:47,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:44:47,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1141a85a0f2cbb32de20 HTTP/1.1" 200 None 2026-03-23 21:44:47,435 - lava_callback - ERROR - Error processing callback for node 69bf1141a85a0f2cbb32de20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60614 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:46:03,570 - lava_callback - INFO - Received callback for node 69bf1188a85a0f2cbb32de2a INFO: 172.19.0.1:51010 - "POST /node/69bf1188a85a0f2cbb32de2a HTTP/1.0" 202 Accepted 2026-03-23 21:46:03,576 - lava_callback - INFO - Starting async job submit for node 69bf1188a85a0f2cbb32de2a 2026-03-23 21:46:03,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:46:03,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1188a85a0f2cbb32de2a HTTP/1.1" 200 None 2026-03-23 21:46:03,616 - lava_callback - DEBUG - Processing node 69bf1188a85a0f2cbb32de2a: baseline-arm64-baylibre 2026-03-23 21:46:03,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1188a85a0f2cbb32de2a 2026-03-23 21:46:03,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:46:03,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1188a85a0f2cbb32de2a HTTP/1.1" 200 None 2026-03-23 21:46:03,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:46:03,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:46:03,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:46:03,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1188a85a0f2cbb32de2a HTTP/1.1" 200 None 2026-03-23 21:46:03,704 - lava_callback - ERROR - Error processing callback for node 69bf1188a85a0f2cbb32de2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57490 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:47:07,472 - lava_callback - INFO - Received callback for node 69bf11d7a85a0f2cbb32de39 INFO: 172.19.0.1:57500 - "POST /node/69bf11d7a85a0f2cbb32de39 HTTP/1.0" 202 Accepted 2026-03-23 21:47:07,477 - lava_callback - INFO - Starting async job submit for node 69bf11d7a85a0f2cbb32de39 2026-03-23 21:47:07,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:47:07,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf11d7a85a0f2cbb32de39 HTTP/1.1" 200 None 2026-03-23 21:47:07,500 - lava_callback - DEBUG - Processing node 69bf11d7a85a0f2cbb32de39: baseline-arm64-clabbe 2026-03-23 21:47:07,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf11d7a85a0f2cbb32de39 2026-03-23 21:47:07,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:47:07,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf11d7a85a0f2cbb32de39 HTTP/1.1" 200 None 2026-03-23 21:47:07,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:47:07,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:47:07,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:47:07,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf11d7a85a0f2cbb32de39 HTTP/1.1" 200 None 2026-03-23 21:47:07,585 - lava_callback - ERROR - Error processing callback for node 69bf11d7a85a0f2cbb32de39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46242 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:48:27,516 - lava_callback - INFO - Received callback for node 69bf1221a85a0f2cbb32de4b INFO: 172.19.0.1:46254 - "POST /node/69bf1221a85a0f2cbb32de4b HTTP/1.0" 202 Accepted 2026-03-23 21:48:27,521 - lava_callback - INFO - Starting async job submit for node 69bf1221a85a0f2cbb32de4b 2026-03-23 21:48:27,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:48:27,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1221a85a0f2cbb32de4b HTTP/1.1" 200 None 2026-03-23 21:48:27,538 - lava_callback - DEBUG - Processing node 69bf1221a85a0f2cbb32de4b: baseline-arm64-clabbe 2026-03-23 21:48:27,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1221a85a0f2cbb32de4b 2026-03-23 21:48:27,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:48:27,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1221a85a0f2cbb32de4b HTTP/1.1" 200 None 2026-03-23 21:48:27,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:48:27,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:48:27,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:48:27,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1221a85a0f2cbb32de4b HTTP/1.1" 200 None 2026-03-23 21:48:27,618 - lava_callback - ERROR - Error processing callback for node 69bf1221a85a0f2cbb32de4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54020 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:49:47,588 - lava_callback - INFO - Received callback for node 69bf126ca85a0f2cbb32de52 INFO: 172.19.0.1:54026 - "POST /node/69bf126ca85a0f2cbb32de52 HTTP/1.0" 202 Accepted 2026-03-23 21:49:47,594 - lava_callback - INFO - Starting async job submit for node 69bf126ca85a0f2cbb32de52 2026-03-23 21:49:47,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:49:47,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf126ca85a0f2cbb32de52 HTTP/1.1" 200 None 2026-03-23 21:49:47,610 - lava_callback - DEBUG - Processing node 69bf126ca85a0f2cbb32de52: baseline-arm64-clabbe 2026-03-23 21:49:47,610 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf126ca85a0f2cbb32de52 2026-03-23 21:49:47,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:49:47,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf126ca85a0f2cbb32de52 HTTP/1.1" 200 None 2026-03-23 21:49:47,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:49:47,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:49:47,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:49:47,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf126ca85a0f2cbb32de52 HTTP/1.1" 200 None 2026-03-23 21:49:47,693 - lava_callback - ERROR - Error processing callback for node 69bf126ca85a0f2cbb32de52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52534 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:57:07,874 - lava_callback - INFO - Received callback for node 69bf1423a85a0f2cbb32dea0 INFO: 172.19.0.1:52536 - "POST /node/69bf1423a85a0f2cbb32dea0 HTTP/1.0" 202 Accepted 2026-03-23 21:57:07,880 - lava_callback - INFO - Starting async job submit for node 69bf1423a85a0f2cbb32dea0 2026-03-23 21:57:07,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:57:07,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1423a85a0f2cbb32dea0 HTTP/1.1" 200 None 2026-03-23 21:57:07,918 - lava_callback - DEBUG - Processing node 69bf1423a85a0f2cbb32dea0: baseline-arm64-clabbe 2026-03-23 21:57:07,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1423a85a0f2cbb32dea0 2026-03-23 21:57:07,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:57:07,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1423a85a0f2cbb32dea0 HTTP/1.1" 200 None 2026-03-23 21:57:07,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:57:07,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 21:57:07,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:57:08,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1423a85a0f2cbb32dea0 HTTP/1.1" 200 None 2026-03-23 21:57:08,019 - lava_callback - ERROR - Error processing callback for node 69bf1423a85a0f2cbb32dea0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42380 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:58:04,767 - lava_callback - INFO - Received callback for node 69bf1465a85a0f2cbb32deaa INFO: 172.19.0.1:52176 - "POST /node/69bf1465a85a0f2cbb32deaa HTTP/1.0" 202 Accepted 2026-03-23 21:58:04,772 - lava_callback - INFO - Starting async job submit for node 69bf1465a85a0f2cbb32deaa 2026-03-23 21:58:04,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:58:04,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1465a85a0f2cbb32deaa HTTP/1.1" 200 None 2026-03-23 21:58:04,804 - lava_callback - DEBUG - Processing node 69bf1465a85a0f2cbb32deaa: baseline-arm64-baylibre 2026-03-23 21:58:04,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1465a85a0f2cbb32deaa 2026-03-23 21:58:04,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:58:04,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1465a85a0f2cbb32deaa HTTP/1.1" 200 None 2026-03-23 21:58:04,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:58:04,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 21:58:04,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:58:04,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1465a85a0f2cbb32deaa HTTP/1.1" 200 None 2026-03-23 21:58:04,864 - lava_callback - ERROR - Error processing callback for node 69bf1465a85a0f2cbb32deaa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44112 - "GET / HTTP/1.0" 200 OK 2026-03-23 21:59:24,284 - lava_callback - INFO - Received callback for node 69bf14b0a85a0f2cbb32deb5 INFO: 172.19.0.1:59436 - "POST /node/69bf14b0a85a0f2cbb32deb5 HTTP/1.0" 202 Accepted 2026-03-23 21:59:24,290 - lava_callback - INFO - Starting async job submit for node 69bf14b0a85a0f2cbb32deb5 2026-03-23 21:59:24,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:59:24,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf14b0a85a0f2cbb32deb5 HTTP/1.1" 200 None 2026-03-23 21:59:24,306 - lava_callback - DEBUG - Processing node 69bf14b0a85a0f2cbb32deb5: baseline-arm64-baylibre 2026-03-23 21:59:24,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf14b0a85a0f2cbb32deb5 2026-03-23 21:59:24,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:59:24,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf14b0a85a0f2cbb32deb5 HTTP/1.1" 200 None 2026-03-23 21:59:24,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:59:24,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 21:59:24,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 21:59:24,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf14b0a85a0f2cbb32deb5 HTTP/1.1" 200 None 2026-03-23 21:59:24,364 - lava_callback - ERROR - Error processing callback for node 69bf14b0a85a0f2cbb32deb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48606 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:01:44,412 - lava_callback - INFO - Received callback for node 69bf1545a85a0f2cbb32deca INFO: 172.19.0.1:55606 - "POST /node/69bf1545a85a0f2cbb32deca HTTP/1.0" 202 Accepted 2026-03-23 22:01:44,417 - lava_callback - INFO - Starting async job submit for node 69bf1545a85a0f2cbb32deca 2026-03-23 22:01:44,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:01:44,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1545a85a0f2cbb32deca HTTP/1.1" 200 None 2026-03-23 22:01:44,442 - lava_callback - DEBUG - Processing node 69bf1545a85a0f2cbb32deca: baseline-arm64-baylibre 2026-03-23 22:01:44,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1545a85a0f2cbb32deca 2026-03-23 22:01:44,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:01:44,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1545a85a0f2cbb32deca HTTP/1.1" 200 None 2026-03-23 22:01:44,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:01:44,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:01:44,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:01:44,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1545a85a0f2cbb32deca HTTP/1.1" 200 None 2026-03-23 22:01:44,526 - lava_callback - ERROR - Error processing callback for node 69bf1545a85a0f2cbb32deca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42710 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:03:04,522 - lava_callback - INFO - Received callback for node 69bf158fa85a0f2cbb32deda INFO: 172.19.0.1:53302 - "POST /node/69bf158fa85a0f2cbb32deda HTTP/1.0" 202 Accepted 2026-03-23 22:03:04,528 - lava_callback - INFO - Starting async job submit for node 69bf158fa85a0f2cbb32deda 2026-03-23 22:03:04,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:03:04,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf158fa85a0f2cbb32deda HTTP/1.1" 200 None 2026-03-23 22:03:04,544 - lava_callback - DEBUG - Processing node 69bf158fa85a0f2cbb32deda: baseline-arm64-baylibre 2026-03-23 22:03:04,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf158fa85a0f2cbb32deda 2026-03-23 22:03:04,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:03:04,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf158fa85a0f2cbb32deda HTTP/1.1" 200 None 2026-03-23 22:03:04,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:03:04,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:03:04,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:03:04,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf158fa85a0f2cbb32deda HTTP/1.1" 200 None 2026-03-23 22:03:04,610 - lava_callback - ERROR - Error processing callback for node 69bf158fa85a0f2cbb32deda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40574 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:04:24,591 - lava_callback - INFO - Received callback for node 69bf15d8a85a0f2cbb32dee1 INFO: 172.19.0.1:60402 - "POST /node/69bf15d8a85a0f2cbb32dee1 HTTP/1.0" 202 Accepted 2026-03-23 22:04:24,597 - lava_callback - INFO - Starting async job submit for node 69bf15d8a85a0f2cbb32dee1 2026-03-23 22:04:24,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:04:24,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf15d8a85a0f2cbb32dee1 HTTP/1.1" 200 None 2026-03-23 22:04:24,613 - lava_callback - DEBUG - Processing node 69bf15d8a85a0f2cbb32dee1: baseline-arm64-baylibre 2026-03-23 22:04:24,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf15d8a85a0f2cbb32dee1 2026-03-23 22:04:24,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:04:24,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf15d8a85a0f2cbb32dee1 HTTP/1.1" 200 None 2026-03-23 22:04:24,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:04:24,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:04:24,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:04:24,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf15d8a85a0f2cbb32dee1 HTTP/1.1" 200 None 2026-03-23 22:04:24,664 - lava_callback - ERROR - Error processing callback for node 69bf15d8a85a0f2cbb32dee1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57256 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:05:48,309 - lava_callback - INFO - Received callback for node 69bf1627a85a0f2cbb32def6 INFO: 172.19.0.1:57268 - "POST /node/69bf1627a85a0f2cbb32def6 HTTP/1.0" 202 Accepted 2026-03-23 22:05:48,315 - lava_callback - INFO - Starting async job submit for node 69bf1627a85a0f2cbb32def6 2026-03-23 22:05:48,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:05:48,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1627a85a0f2cbb32def6 HTTP/1.1" 200 None 2026-03-23 22:05:48,332 - lava_callback - DEBUG - Processing node 69bf1627a85a0f2cbb32def6: baseline-arm64-clabbe 2026-03-23 22:05:48,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1627a85a0f2cbb32def6 2026-03-23 22:05:48,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:05:48,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1627a85a0f2cbb32def6 HTTP/1.1" 200 None 2026-03-23 22:05:48,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:05:48,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:05:48,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:05:48,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1627a85a0f2cbb32def6 HTTP/1.1" 200 None 2026-03-23 22:05:48,404 - lava_callback - ERROR - Error processing callback for node 69bf1627a85a0f2cbb32def6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43646 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:06:48,281 - lava_callback - INFO - Received callback for node 69bf1670a85a0f2cbb32defe INFO: 172.19.0.1:43648 - "POST /node/69bf1670a85a0f2cbb32defe HTTP/1.0" 202 Accepted 2026-03-23 22:06:48,287 - lava_callback - INFO - Starting async job submit for node 69bf1670a85a0f2cbb32defe 2026-03-23 22:06:48,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:06:48,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1670a85a0f2cbb32defe HTTP/1.1" 200 None 2026-03-23 22:06:48,303 - lava_callback - DEBUG - Processing node 69bf1670a85a0f2cbb32defe: baseline-arm64-clabbe 2026-03-23 22:06:48,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1670a85a0f2cbb32defe 2026-03-23 22:06:48,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:06:48,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1670a85a0f2cbb32defe HTTP/1.1" 200 None 2026-03-23 22:06:48,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:06:48,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:06:48,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:06:48,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1670a85a0f2cbb32defe HTTP/1.1" 200 None 2026-03-23 22:06:48,370 - lava_callback - ERROR - Error processing callback for node 69bf1670a85a0f2cbb32defe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57532 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:08:08,355 - lava_callback - INFO - Received callback for node 69bf16baa85a0f2cbb32df12 INFO: 172.19.0.1:57534 - "POST /node/69bf16baa85a0f2cbb32df12 HTTP/1.0" 202 Accepted 2026-03-23 22:08:08,361 - lava_callback - INFO - Starting async job submit for node 69bf16baa85a0f2cbb32df12 2026-03-23 22:08:08,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:08:08,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf16baa85a0f2cbb32df12 HTTP/1.1" 200 None 2026-03-23 22:08:08,398 - lava_callback - DEBUG - Processing node 69bf16baa85a0f2cbb32df12: baseline-arm64-clabbe 2026-03-23 22:08:08,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf16baa85a0f2cbb32df12 2026-03-23 22:08:08,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:08:08,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf16baa85a0f2cbb32df12 HTTP/1.1" 200 None 2026-03-23 22:08:08,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:08:08,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:08:08,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:08:08,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf16baa85a0f2cbb32df12 HTTP/1.1" 200 None 2026-03-23 22:08:08,455 - lava_callback - ERROR - Error processing callback for node 69bf16baa85a0f2cbb32df12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51656 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:09:28,386 - lava_callback - INFO - Received callback for node 69bf1703a85a0f2cbb32df1c INFO: 172.19.0.1:51658 - "POST /node/69bf1703a85a0f2cbb32df1c HTTP/1.0" 202 Accepted 2026-03-23 22:09:28,391 - lava_callback - INFO - Starting async job submit for node 69bf1703a85a0f2cbb32df1c 2026-03-23 22:09:28,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:09:28,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1703a85a0f2cbb32df1c HTTP/1.1" 200 None 2026-03-23 22:09:28,419 - lava_callback - DEBUG - Processing node 69bf1703a85a0f2cbb32df1c: baseline-arm64-clabbe 2026-03-23 22:09:28,419 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1703a85a0f2cbb32df1c 2026-03-23 22:09:28,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:09:28,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1703a85a0f2cbb32df1c HTTP/1.1" 200 None 2026-03-23 22:09:28,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:09:28,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:09:28,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:09:28,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1703a85a0f2cbb32df1c HTTP/1.1" 200 None 2026-03-23 22:09:28,482 - lava_callback - ERROR - Error processing callback for node 69bf1703a85a0f2cbb32df1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56598 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:10:28,454 - lava_callback - INFO - Received callback for node 69bf174ea85a0f2cbb32df2b INFO: 172.19.0.1:56600 - "POST /node/69bf174ea85a0f2cbb32df2b HTTP/1.0" 202 Accepted 2026-03-23 22:10:28,460 - lava_callback - INFO - Starting async job submit for node 69bf174ea85a0f2cbb32df2b 2026-03-23 22:10:28,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:10:28,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf174ea85a0f2cbb32df2b HTTP/1.1" 200 None 2026-03-23 22:10:28,484 - lava_callback - DEBUG - Processing node 69bf174ea85a0f2cbb32df2b: baseline-arm64-clabbe 2026-03-23 22:10:28,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf174ea85a0f2cbb32df2b 2026-03-23 22:10:28,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:10:28,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf174ea85a0f2cbb32df2b HTTP/1.1" 200 None 2026-03-23 22:10:28,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:10:28,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:10:28,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:10:28,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf174ea85a0f2cbb32df2b HTTP/1.1" 200 None 2026-03-23 22:10:28,547 - lava_callback - ERROR - Error processing callback for node 69bf174ea85a0f2cbb32df2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37148 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:11:48,511 - lava_callback - INFO - Received callback for node 69bf1798a85a0f2cbb32df39 INFO: 172.19.0.1:37152 - "POST /node/69bf1798a85a0f2cbb32df39 HTTP/1.0" 202 Accepted 2026-03-23 22:11:48,517 - lava_callback - INFO - Starting async job submit for node 69bf1798a85a0f2cbb32df39 2026-03-23 22:11:48,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:11:48,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1798a85a0f2cbb32df39 HTTP/1.1" 200 None 2026-03-23 22:11:48,533 - lava_callback - DEBUG - Processing node 69bf1798a85a0f2cbb32df39: baseline-arm64-clabbe 2026-03-23 22:11:48,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1798a85a0f2cbb32df39 2026-03-23 22:11:48,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:11:48,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1798a85a0f2cbb32df39 HTTP/1.1" 200 None 2026-03-23 22:11:48,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:11:48,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69be5461448e074b3ffe163c HTTP/1.1" 200 None 2026-03-23 22:11:48,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:11:48,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1798a85a0f2cbb32df39 HTTP/1.1" 200 None 2026-03-23 22:11:48,593 - lava_callback - ERROR - Error processing callback for node 69bf1798a85a0f2cbb32df39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39556 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:13:08,527 - lava_callback - INFO - Received callback for node 69bf17e1a85a0f2cbb32df4e INFO: 172.19.0.1:39566 - "POST /node/69bf17e1a85a0f2cbb32df4e HTTP/1.0" 202 Accepted 2026-03-23 22:13:08,532 - lava_callback - INFO - Starting async job submit for node 69bf17e1a85a0f2cbb32df4e 2026-03-23 22:13:08,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:13:08,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf17e1a85a0f2cbb32df4e HTTP/1.1" 200 None 2026-03-23 22:13:08,548 - lava_callback - DEBUG - Processing node 69bf17e1a85a0f2cbb32df4e: baseline-arm64-clabbe 2026-03-23 22:13:08,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf17e1a85a0f2cbb32df4e 2026-03-23 22:13:08,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:13:08,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf17e1a85a0f2cbb32df4e HTTP/1.1" 200 None 2026-03-23 22:13:08,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:13:08,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 22:13:08,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:13:08,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf17e1a85a0f2cbb32df4e HTTP/1.1" 200 None 2026-03-23 22:13:08,606 - lava_callback - ERROR - Error processing callback for node 69bf17e1a85a0f2cbb32df4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53186 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:14:08,651 - lava_callback - INFO - Received callback for node 69bf182ba85a0f2cbb32df5b INFO: 172.19.0.1:53202 - "POST /node/69bf182ba85a0f2cbb32df5b HTTP/1.0" 202 Accepted 2026-03-23 22:14:08,656 - lava_callback - INFO - Starting async job submit for node 69bf182ba85a0f2cbb32df5b 2026-03-23 22:14:08,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:14:08,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf182ba85a0f2cbb32df5b HTTP/1.1" 200 None 2026-03-23 22:14:08,674 - lava_callback - DEBUG - Processing node 69bf182ba85a0f2cbb32df5b: baseline-arm64-clabbe 2026-03-23 22:14:08,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf182ba85a0f2cbb32df5b 2026-03-23 22:14:08,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:14:08,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf182ba85a0f2cbb32df5b HTTP/1.1" 200 None 2026-03-23 22:14:08,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:14:08,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 22:14:08,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:14:08,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf182ba85a0f2cbb32df5b HTTP/1.1" 200 None 2026-03-23 22:14:08,734 - lava_callback - ERROR - Error processing callback for node 69bf182ba85a0f2cbb32df5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54082 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:15:05,607 - lava_callback - INFO - Received callback for node 69bf1862a85a0f2cbb32df65 INFO: 172.19.0.1:45772 - "POST /node/69bf1862a85a0f2cbb32df65 HTTP/1.0" 202 Accepted 2026-03-23 22:15:05,613 - lava_callback - INFO - Starting async job submit for node 69bf1862a85a0f2cbb32df65 2026-03-23 22:15:05,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:05,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1862a85a0f2cbb32df65 HTTP/1.1" 200 None 2026-03-23 22:15:05,629 - lava_callback - DEBUG - Processing node 69bf1862a85a0f2cbb32df65: baseline-arm-baylibre 2026-03-23 22:15:05,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1862a85a0f2cbb32df65 2026-03-23 22:15:05,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:05,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1862a85a0f2cbb32df65 HTTP/1.1" 200 None 2026-03-23 22:15:05,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:05,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:15:05,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:05,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1862a85a0f2cbb32df65 HTTP/1.1" 200 None 2026-03-23 22:15:05,692 - lava_callback - ERROR - Error processing callback for node 69bf1862a85a0f2cbb32df65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37358 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:15:45,177 - lava_callback - INFO - Received callback for node 69bf1886a85a0f2cbb32df73 INFO: 172.19.0.1:54498 - "POST /node/69bf1886a85a0f2cbb32df73 HTTP/1.0" 202 Accepted 2026-03-23 22:15:45,183 - lava_callback - INFO - Starting async job submit for node 69bf1886a85a0f2cbb32df73 2026-03-23 22:15:45,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:45,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1886a85a0f2cbb32df73 HTTP/1.1" 200 None 2026-03-23 22:15:45,199 - lava_callback - DEBUG - Processing node 69bf1886a85a0f2cbb32df73: baseline-arm-baylibre 2026-03-23 22:15:45,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1886a85a0f2cbb32df73 2026-03-23 22:15:45,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:45,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1886a85a0f2cbb32df73 HTTP/1.1" 200 None 2026-03-23 22:15:45,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:45,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:15:45,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:15:45,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1886a85a0f2cbb32df73 HTTP/1.1" 200 None 2026-03-23 22:15:45,264 - lava_callback - ERROR - Error processing callback for node 69bf1886a85a0f2cbb32df73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56736 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:16:48,692 - lava_callback - INFO - Received callback for node 69bf18bca85a0f2cbb32df81 INFO: 172.19.0.1:56746 - "POST /node/69bf18bca85a0f2cbb32df81 HTTP/1.0" 202 Accepted 2026-03-23 22:16:48,697 - lava_callback - INFO - Starting async job submit for node 69bf18bca85a0f2cbb32df81 2026-03-23 22:16:48,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:16:48,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf18bca85a0f2cbb32df81 HTTP/1.1" 200 None 2026-03-23 22:16:48,721 - lava_callback - DEBUG - Processing node 69bf18bca85a0f2cbb32df81: baseline-arm64-clabbe 2026-03-23 22:16:48,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf18bca85a0f2cbb32df81 2026-03-23 22:16:48,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:16:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf18bca85a0f2cbb32df81 HTTP/1.1" 200 None 2026-03-23 22:16:48,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:16:48,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-23 22:16:48,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:16:48,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf18bca85a0f2cbb32df81 HTTP/1.1" 200 None 2026-03-23 22:16:48,840 - lava_callback - ERROR - Error processing callback for node 69bf18bca85a0f2cbb32df81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56788 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:17:45,325 - lava_callback - INFO - Received callback for node 69bf18f3a85a0f2cbb32df87 INFO: 172.19.0.1:44898 - "POST /node/69bf18f3a85a0f2cbb32df87 HTTP/1.0" 202 Accepted 2026-03-23 22:17:45,330 - lava_callback - INFO - Starting async job submit for node 69bf18f3a85a0f2cbb32df87 2026-03-23 22:17:45,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:17:45,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf18f3a85a0f2cbb32df87 HTTP/1.1" 200 None 2026-03-23 22:17:45,349 - lava_callback - DEBUG - Processing node 69bf18f3a85a0f2cbb32df87: baseline-arm-baylibre 2026-03-23 22:17:45,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf18f3a85a0f2cbb32df87 2026-03-23 22:17:45,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:17:45,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf18f3a85a0f2cbb32df87 HTTP/1.1" 200 None 2026-03-23 22:17:45,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:17:45,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:17:45,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:17:45,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf18f3a85a0f2cbb32df87 HTTP/1.1" 200 None 2026-03-23 22:17:45,405 - lava_callback - ERROR - Error processing callback for node 69bf18f3a85a0f2cbb32df87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51430 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:18:05,290 - lava_callback - INFO - Received callback for node 69bf1917a85a0f2cbb32df90 INFO: 172.19.0.1:52508 - "POST /node/69bf1917a85a0f2cbb32df90 HTTP/1.0" 202 Accepted 2026-03-23 22:18:05,296 - lava_callback - INFO - Starting async job submit for node 69bf1917a85a0f2cbb32df90 2026-03-23 22:18:05,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:05,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1917a85a0f2cbb32df90 HTTP/1.1" 200 None 2026-03-23 22:18:05,324 - lava_callback - DEBUG - Processing node 69bf1917a85a0f2cbb32df90: baseline-arm-baylibre 2026-03-23 22:18:05,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1917a85a0f2cbb32df90 2026-03-23 22:18:05,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:05,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1917a85a0f2cbb32df90 HTTP/1.1" 200 None 2026-03-23 22:18:05,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:05,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:18:05,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:05,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1917a85a0f2cbb32df90 HTTP/1.1" 200 None 2026-03-23 22:18:05,401 - lava_callback - ERROR - Error processing callback for node 69bf1917a85a0f2cbb32df90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35836 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:18:45,349 - lava_callback - INFO - Received callback for node 69bf193ca85a0f2cbb32df99 INFO: 172.19.0.1:58524 - "POST /node/69bf193ca85a0f2cbb32df99 HTTP/1.0" 202 Accepted 2026-03-23 22:18:45,355 - lava_callback - INFO - Starting async job submit for node 69bf193ca85a0f2cbb32df99 2026-03-23 22:18:45,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:45,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf193ca85a0f2cbb32df99 HTTP/1.1" 200 None 2026-03-23 22:18:45,371 - lava_callback - DEBUG - Processing node 69bf193ca85a0f2cbb32df99: baseline-arm-baylibre 2026-03-23 22:18:45,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf193ca85a0f2cbb32df99 2026-03-23 22:18:45,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:45,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf193ca85a0f2cbb32df99 HTTP/1.1" 200 None 2026-03-23 22:18:45,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:45,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:18:45,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:18:45,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf193ca85a0f2cbb32df99 HTTP/1.1" 200 None 2026-03-23 22:18:45,435 - lava_callback - ERROR - Error processing callback for node 69bf193ca85a0f2cbb32df99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37934 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:19:25,435 - lava_callback - INFO - Received callback for node 69bf195da85a0f2cbb32dfa2 INFO: 172.19.0.1:42342 - "POST /node/69bf195da85a0f2cbb32dfa2 HTTP/1.0" 202 Accepted 2026-03-23 22:19:25,440 - lava_callback - INFO - Starting async job submit for node 69bf195da85a0f2cbb32dfa2 2026-03-23 22:19:25,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:19:25,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf195da85a0f2cbb32dfa2 HTTP/1.1" 200 None 2026-03-23 22:19:25,457 - lava_callback - DEBUG - Processing node 69bf195da85a0f2cbb32dfa2: baseline-arm-baylibre 2026-03-23 22:19:25,457 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf195da85a0f2cbb32dfa2 2026-03-23 22:19:25,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:19:25,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf195da85a0f2cbb32dfa2 HTTP/1.1" 200 None 2026-03-23 22:19:25,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:19:25,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:19:25,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:19:25,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf195da85a0f2cbb32dfa2 HTTP/1.1" 200 None 2026-03-23 22:19:25,535 - lava_callback - ERROR - Error processing callback for node 69bf195da85a0f2cbb32dfa2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48032 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:20:05,439 - lava_callback - INFO - Received callback for node 69bf1982a85a0f2cbb32dfb2 INFO: 172.19.0.1:40772 - "POST /node/69bf1982a85a0f2cbb32dfb2 HTTP/1.0" 202 Accepted 2026-03-23 22:20:05,445 - lava_callback - INFO - Starting async job submit for node 69bf1982a85a0f2cbb32dfb2 2026-03-23 22:20:05,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:05,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1982a85a0f2cbb32dfb2 HTTP/1.1" 200 None 2026-03-23 22:20:05,462 - lava_callback - DEBUG - Processing node 69bf1982a85a0f2cbb32dfb2: baseline-arm-baylibre 2026-03-23 22:20:05,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1982a85a0f2cbb32dfb2 2026-03-23 22:20:05,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:05,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1982a85a0f2cbb32dfb2 HTTP/1.1" 200 None 2026-03-23 22:20:05,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:05,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:20:05,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:05,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1982a85a0f2cbb32dfb2 HTTP/1.1" 200 None 2026-03-23 22:20:05,523 - lava_callback - ERROR - Error processing callback for node 69bf1982a85a0f2cbb32dfb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46848 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:20:28,813 - lava_callback - INFO - Received callback for node 69bf19a7a85a0f2cbb32dfbf INFO: 172.19.0.1:46854 - "POST /node/69bf19a7a85a0f2cbb32dfbf HTTP/1.0" 202 Accepted 2026-03-23 22:20:28,819 - lava_callback - INFO - Starting async job submit for node 69bf19a7a85a0f2cbb32dfbf 2026-03-23 22:20:28,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:28,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf19a7a85a0f2cbb32dfbf HTTP/1.1" 200 None 2026-03-23 22:20:28,836 - lava_callback - DEBUG - Processing node 69bf19a7a85a0f2cbb32dfbf: baseline-arm-clabbe 2026-03-23 22:20:28,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf19a7a85a0f2cbb32dfbf 2026-03-23 22:20:28,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:28,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf19a7a85a0f2cbb32dfbf HTTP/1.1" 200 None 2026-03-23 22:20:28,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:28,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:20:28,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:20:28,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf19a7a85a0f2cbb32dfbf HTTP/1.1" 200 None 2026-03-23 22:20:28,918 - lava_callback - ERROR - Error processing callback for node 69bf19a7a85a0f2cbb32dfbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55312 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:21:05,533 - lava_callback - INFO - Received callback for node 69bf19c8a85a0f2cbb32dfc7 INFO: 172.19.0.1:36812 - "POST /node/69bf19c8a85a0f2cbb32dfc7 HTTP/1.0" 202 Accepted 2026-03-23 22:21:05,539 - lava_callback - INFO - Starting async job submit for node 69bf19c8a85a0f2cbb32dfc7 2026-03-23 22:21:05,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:05,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf19c8a85a0f2cbb32dfc7 HTTP/1.1" 200 None 2026-03-23 22:21:05,580 - lava_callback - DEBUG - Processing node 69bf19c8a85a0f2cbb32dfc7: baseline-arm-baylibre 2026-03-23 22:21:05,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf19c8a85a0f2cbb32dfc7 2026-03-23 22:21:05,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:05,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf19c8a85a0f2cbb32dfc7 HTTP/1.1" 200 None 2026-03-23 22:21:05,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:05,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:21:05,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:05,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf19c8a85a0f2cbb32dfc7 HTTP/1.1" 200 None 2026-03-23 22:21:05,642 - lava_callback - ERROR - Error processing callback for node 69bf19c8a85a0f2cbb32dfc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46762 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:21:48,879 - lava_callback - INFO - Received callback for node 69bf19eea85a0f2cbb32dfd1 INFO: 172.19.0.1:46774 - "POST /node/69bf19eea85a0f2cbb32dfd1 HTTP/1.0" 202 Accepted 2026-03-23 22:21:48,885 - lava_callback - INFO - Starting async job submit for node 69bf19eea85a0f2cbb32dfd1 2026-03-23 22:21:48,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:48,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf19eea85a0f2cbb32dfd1 HTTP/1.1" 200 None 2026-03-23 22:21:48,924 - lava_callback - DEBUG - Processing node 69bf19eea85a0f2cbb32dfd1: baseline-arm-clabbe 2026-03-23 22:21:48,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf19eea85a0f2cbb32dfd1 2026-03-23 22:21:48,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:48,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf19eea85a0f2cbb32dfd1 HTTP/1.1" 200 None 2026-03-23 22:21:48,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:48,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:21:48,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:21:49,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf19eea85a0f2cbb32dfd1 HTTP/1.1" 200 None 2026-03-23 22:21:49,015 - lava_callback - ERROR - Error processing callback for node 69bf19eea85a0f2cbb32dfd1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59936 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:22:25,598 - lava_callback - INFO - Received callback for node 69bf1a10a85a0f2cbb32dfdc INFO: 172.19.0.1:57902 - "POST /node/69bf1a10a85a0f2cbb32dfdc HTTP/1.0" 202 Accepted 2026-03-23 22:22:25,604 - lava_callback - INFO - Starting async job submit for node 69bf1a10a85a0f2cbb32dfdc 2026-03-23 22:22:25,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:25,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a10a85a0f2cbb32dfdc HTTP/1.1" 200 None 2026-03-23 22:22:25,620 - lava_callback - DEBUG - Processing node 69bf1a10a85a0f2cbb32dfdc: baseline-arm-baylibre 2026-03-23 22:22:25,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1a10a85a0f2cbb32dfdc 2026-03-23 22:22:25,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:25,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a10a85a0f2cbb32dfdc HTTP/1.1" 200 None 2026-03-23 22:22:25,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:25,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:22:25,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:25,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1a10a85a0f2cbb32dfdc HTTP/1.1" 200 None 2026-03-23 22:22:25,696 - lava_callback - ERROR - Error processing callback for node 69bf1a10a85a0f2cbb32dfdc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42050 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:22:48,933 - lava_callback - INFO - Received callback for node 69bf1a35a85a0f2cbb32dfe7 INFO: 172.19.0.1:42062 - "POST /node/69bf1a35a85a0f2cbb32dfe7 HTTP/1.0" 202 Accepted 2026-03-23 22:22:48,938 - lava_callback - INFO - Starting async job submit for node 69bf1a35a85a0f2cbb32dfe7 2026-03-23 22:22:48,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:48,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a35a85a0f2cbb32dfe7 HTTP/1.1" 200 None 2026-03-23 22:22:48,954 - lava_callback - DEBUG - Processing node 69bf1a35a85a0f2cbb32dfe7: baseline-arm-clabbe 2026-03-23 22:22:48,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1a35a85a0f2cbb32dfe7 2026-03-23 22:22:48,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:48,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a35a85a0f2cbb32dfe7 HTTP/1.1" 200 None 2026-03-23 22:22:48,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:48,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:22:48,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:22:49,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1a35a85a0f2cbb32dfe7 HTTP/1.1" 200 None 2026-03-23 22:22:49,033 - lava_callback - ERROR - Error processing callback for node 69bf1a35a85a0f2cbb32dfe7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57006 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:23:28,923 - lava_callback - INFO - Received callback for node 69bf1a59a85a0f2cbb32dff5 INFO: 172.19.0.1:57020 - "POST /node/69bf1a59a85a0f2cbb32dff5 HTTP/1.0" 202 Accepted 2026-03-23 22:23:28,928 - lava_callback - INFO - Starting async job submit for node 69bf1a59a85a0f2cbb32dff5 2026-03-23 22:23:28,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:23:28,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a59a85a0f2cbb32dff5 HTTP/1.1" 200 None 2026-03-23 22:23:28,966 - lava_callback - DEBUG - Processing node 69bf1a59a85a0f2cbb32dff5: baseline-arm-clabbe 2026-03-23 22:23:28,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1a59a85a0f2cbb32dff5 2026-03-23 22:23:28,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:23:28,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a59a85a0f2cbb32dff5 HTTP/1.1" 200 None 2026-03-23 22:23:28,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:23:29,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:23:29,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:23:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1a59a85a0f2cbb32dff5 HTTP/1.1" 200 None 2026-03-23 22:23:29,067 - lava_callback - ERROR - Error processing callback for node 69bf1a59a85a0f2cbb32dff5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48936 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:24:08,986 - lava_callback - INFO - Received callback for node 69bf1a7da85a0f2cbb32dfff INFO: 172.19.0.1:48946 - "POST /node/69bf1a7da85a0f2cbb32dfff HTTP/1.0" 202 Accepted 2026-03-23 22:24:08,991 - lava_callback - INFO - Starting async job submit for node 69bf1a7da85a0f2cbb32dfff 2026-03-23 22:24:08,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:09,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a7da85a0f2cbb32dfff HTTP/1.1" 200 None 2026-03-23 22:24:09,014 - lava_callback - DEBUG - Processing node 69bf1a7da85a0f2cbb32dfff: baseline-arm-clabbe 2026-03-23 22:24:09,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1a7da85a0f2cbb32dfff 2026-03-23 22:24:09,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:09,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1a7da85a0f2cbb32dfff HTTP/1.1" 200 None 2026-03-23 22:24:09,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:09,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:24:09,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:09,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1a7da85a0f2cbb32dfff HTTP/1.1" 200 None 2026-03-23 22:24:09,087 - lava_callback - ERROR - Error processing callback for node 69bf1a7da85a0f2cbb32dfff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34790 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:24:48,994 - lava_callback - INFO - Received callback for node 69bf1aa1a85a0f2cbb32e00b INFO: 172.19.0.1:34802 - "POST /node/69bf1aa1a85a0f2cbb32e00b HTTP/1.0" 202 Accepted 2026-03-23 22:24:49,000 - lava_callback - INFO - Starting async job submit for node 69bf1aa1a85a0f2cbb32e00b 2026-03-23 22:24:49,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:49,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1aa1a85a0f2cbb32e00b HTTP/1.1" 200 None 2026-03-23 22:24:49,016 - lava_callback - DEBUG - Processing node 69bf1aa1a85a0f2cbb32e00b: baseline-arm-clabbe 2026-03-23 22:24:49,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1aa1a85a0f2cbb32e00b 2026-03-23 22:24:49,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:49,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1aa1a85a0f2cbb32e00b HTTP/1.1" 200 None 2026-03-23 22:24:49,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:49,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:24:49,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:24:49,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1aa1a85a0f2cbb32e00b HTTP/1.1" 200 None 2026-03-23 22:24:49,109 - lava_callback - ERROR - Error processing callback for node 69bf1aa1a85a0f2cbb32e00b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34436 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:25:29,056 - lava_callback - INFO - Received callback for node 69bf1ac6a85a0f2cbb32e017 INFO: 172.19.0.1:34450 - "POST /node/69bf1ac6a85a0f2cbb32e017 HTTP/1.0" 202 Accepted 2026-03-23 22:25:29,062 - lava_callback - INFO - Starting async job submit for node 69bf1ac6a85a0f2cbb32e017 2026-03-23 22:25:29,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:29,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1ac6a85a0f2cbb32e017 HTTP/1.1" 200 None 2026-03-23 22:25:29,078 - lava_callback - DEBUG - Processing node 69bf1ac6a85a0f2cbb32e017: baseline-arm-clabbe 2026-03-23 22:25:29,079 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1ac6a85a0f2cbb32e017 2026-03-23 22:25:29,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:29,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1ac6a85a0f2cbb32e017 HTTP/1.1" 200 None 2026-03-23 22:25:29,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:29,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:25:29,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:29,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1ac6a85a0f2cbb32e017 HTTP/1.1" 200 None 2026-03-23 22:25:29,159 - lava_callback - ERROR - Error processing callback for node 69bf1ac6a85a0f2cbb32e017: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38762 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:25:49,031 - lava_callback - INFO - Received callback for node 69bf1aeaa85a0f2cbb32e023 INFO: 172.19.0.1:38766 - "POST /node/69bf1aeaa85a0f2cbb32e023 HTTP/1.0" 202 Accepted 2026-03-23 22:25:49,036 - lava_callback - INFO - Starting async job submit for node 69bf1aeaa85a0f2cbb32e023 2026-03-23 22:25:49,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:49,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1aeaa85a0f2cbb32e023 HTTP/1.1" 200 None 2026-03-23 22:25:49,052 - lava_callback - DEBUG - Processing node 69bf1aeaa85a0f2cbb32e023: baseline-arm-clabbe 2026-03-23 22:25:49,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1aeaa85a0f2cbb32e023 2026-03-23 22:25:49,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:49,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1aeaa85a0f2cbb32e023 HTTP/1.1" 200 None 2026-03-23 22:25:49,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:49,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:25:49,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:25:49,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1aeaa85a0f2cbb32e023 HTTP/1.1" 200 None 2026-03-23 22:25:49,107 - lava_callback - ERROR - Error processing callback for node 69bf1aeaa85a0f2cbb32e023: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55196 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:26:29,115 - lava_callback - INFO - Received callback for node 69bf1b0da85a0f2cbb32e031 INFO: 172.19.0.1:55198 - "POST /node/69bf1b0da85a0f2cbb32e031 HTTP/1.0" 202 Accepted 2026-03-23 22:26:29,121 - lava_callback - INFO - Starting async job submit for node 69bf1b0da85a0f2cbb32e031 2026-03-23 22:26:29,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:26:29,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1b0da85a0f2cbb32e031 HTTP/1.1" 200 None 2026-03-23 22:26:29,156 - lava_callback - DEBUG - Processing node 69bf1b0da85a0f2cbb32e031: baseline-arm-clabbe 2026-03-23 22:26:29,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1b0da85a0f2cbb32e031 2026-03-23 22:26:29,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:26:29,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1b0da85a0f2cbb32e031 HTTP/1.1" 200 None 2026-03-23 22:26:29,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:26:29,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:26:29,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:26:29,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1b0da85a0f2cbb32e031 HTTP/1.1" 200 None 2026-03-23 22:26:29,256 - lava_callback - ERROR - Error processing callback for node 69bf1b0da85a0f2cbb32e031: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40360 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:27:09,097 - lava_callback - INFO - Received callback for node 69bf1b32a85a0f2cbb32e03b INFO: 172.19.0.1:40370 - "POST /node/69bf1b32a85a0f2cbb32e03b HTTP/1.0" 202 Accepted 2026-03-23 22:27:09,103 - lava_callback - INFO - Starting async job submit for node 69bf1b32a85a0f2cbb32e03b 2026-03-23 22:27:09,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:27:09,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1b32a85a0f2cbb32e03b HTTP/1.1" 200 None 2026-03-23 22:27:09,124 - lava_callback - DEBUG - Processing node 69bf1b32a85a0f2cbb32e03b: baseline-arm-clabbe 2026-03-23 22:27:09,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1b32a85a0f2cbb32e03b 2026-03-23 22:27:09,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:27:09,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1b32a85a0f2cbb32e03b HTTP/1.1" 200 None 2026-03-23 22:27:09,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:27:09,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-23 22:27:09,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:27:09,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1b32a85a0f2cbb32e03b HTTP/1.1" 200 None 2026-03-23 22:27:09,176 - lava_callback - ERROR - Error processing callback for node 69bf1b32a85a0f2cbb32e03b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38612 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59226 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:41:27,300 - lava_callback - INFO - Received callback for node 69bf1e92a85a0f2cbb32e04d INFO: 172.19.0.1:59240 - "POST /node/69bf1e92a85a0f2cbb32e04d HTTP/1.0" 202 Accepted 2026-03-23 22:41:27,305 - lava_callback - INFO - Starting async job submit for node 69bf1e92a85a0f2cbb32e04d 2026-03-23 22:41:27,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:41:27,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1e92a85a0f2cbb32e04d HTTP/1.1" 200 None 2026-03-23 22:41:27,322 - lava_callback - DEBUG - Processing node 69bf1e92a85a0f2cbb32e04d: baseline-arm64-baylibre 2026-03-23 22:41:27,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1e92a85a0f2cbb32e04d 2026-03-23 22:41:27,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:41:27,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1e92a85a0f2cbb32e04d HTTP/1.1" 200 None 2026-03-23 22:41:27,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:41:27,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:41:27,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:41:27,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1e92a85a0f2cbb32e04d HTTP/1.1" 200 None 2026-03-23 22:41:27,386 - lava_callback - ERROR - Error processing callback for node 69bf1e92a85a0f2cbb32e04d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40940 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:42:46,849 - lava_callback - INFO - Received callback for node 69bf1edca85a0f2cbb32e057 INFO: 172.19.0.1:40942 - "POST /node/69bf1edca85a0f2cbb32e057 HTTP/1.0" 202 Accepted 2026-03-23 22:42:46,855 - lava_callback - INFO - Starting async job submit for node 69bf1edca85a0f2cbb32e057 2026-03-23 22:42:46,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:42:46,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1edca85a0f2cbb32e057 HTTP/1.1" 200 None 2026-03-23 22:42:46,871 - lava_callback - DEBUG - Processing node 69bf1edca85a0f2cbb32e057: baseline-arm64-baylibre 2026-03-23 22:42:46,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1edca85a0f2cbb32e057 2026-03-23 22:42:46,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:42:46,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1edca85a0f2cbb32e057 HTTP/1.1" 200 None 2026-03-23 22:42:46,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:42:46,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:42:46,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:42:46,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1edca85a0f2cbb32e057 HTTP/1.1" 200 None 2026-03-23 22:42:46,923 - lava_callback - ERROR - Error processing callback for node 69bf1edca85a0f2cbb32e057: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51932 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:45:06,853 - lava_callback - INFO - Received callback for node 69bf1f6ca85a0f2cbb32e06b INFO: 172.19.0.1:51938 - "POST /node/69bf1f6ca85a0f2cbb32e06b HTTP/1.0" 202 Accepted 2026-03-23 22:45:06,859 - lava_callback - INFO - Starting async job submit for node 69bf1f6ca85a0f2cbb32e06b 2026-03-23 22:45:06,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:45:06,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1f6ca85a0f2cbb32e06b HTTP/1.1" 200 None 2026-03-23 22:45:06,876 - lava_callback - DEBUG - Processing node 69bf1f6ca85a0f2cbb32e06b: baseline-arm64-baylibre 2026-03-23 22:45:06,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1f6ca85a0f2cbb32e06b 2026-03-23 22:45:06,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:45:06,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1f6ca85a0f2cbb32e06b HTTP/1.1" 200 None 2026-03-23 22:45:06,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:45:06,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:45:06,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:45:06,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1f6ca85a0f2cbb32e06b HTTP/1.1" 200 None 2026-03-23 22:45:06,975 - lava_callback - ERROR - Error processing callback for node 69bf1f6ca85a0f2cbb32e06b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52614 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:46:26,968 - lava_callback - INFO - Received callback for node 69bf1fb4a85a0f2cbb32e076 INFO: 172.19.0.1:52620 - "POST /node/69bf1fb4a85a0f2cbb32e076 HTTP/1.0" 202 Accepted 2026-03-23 22:46:26,973 - lava_callback - INFO - Starting async job submit for node 69bf1fb4a85a0f2cbb32e076 2026-03-23 22:46:26,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:46:26,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1fb4a85a0f2cbb32e076 HTTP/1.1" 200 None 2026-03-23 22:46:26,989 - lava_callback - DEBUG - Processing node 69bf1fb4a85a0f2cbb32e076: baseline-arm64-baylibre 2026-03-23 22:46:26,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1fb4a85a0f2cbb32e076 2026-03-23 22:46:26,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:46:27,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1fb4a85a0f2cbb32e076 HTTP/1.1" 200 None 2026-03-23 22:46:27,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:46:27,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:46:27,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:46:27,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1fb4a85a0f2cbb32e076 HTTP/1.1" 200 None 2026-03-23 22:46:27,048 - lava_callback - ERROR - Error processing callback for node 69bf1fb4a85a0f2cbb32e076: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33104 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:47:46,999 - lava_callback - INFO - Received callback for node 69bf1fffa85a0f2cbb32e090 INFO: 172.19.0.1:33106 - "POST /node/69bf1fffa85a0f2cbb32e090 HTTP/1.0" 202 Accepted 2026-03-23 22:47:47,006 - lava_callback - INFO - Starting async job submit for node 69bf1fffa85a0f2cbb32e090 2026-03-23 22:47:47,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:47:47,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1fffa85a0f2cbb32e090 HTTP/1.1" 200 None 2026-03-23 22:47:47,021 - lava_callback - DEBUG - Processing node 69bf1fffa85a0f2cbb32e090: baseline-arm64-baylibre 2026-03-23 22:47:47,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf1fffa85a0f2cbb32e090 2026-03-23 22:47:47,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:47:47,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf1fffa85a0f2cbb32e090 HTTP/1.1" 200 None 2026-03-23 22:47:47,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:47:47,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:47:47,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:47:47,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf1fffa85a0f2cbb32e090 HTTP/1.1" 200 None 2026-03-23 22:47:47,074 - lava_callback - ERROR - Error processing callback for node 69bf1fffa85a0f2cbb32e090: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53998 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:49:47,096 - lava_callback - INFO - Received callback for node 69bf2084a85a0f2cbb32e0c7 INFO: 172.19.0.1:54002 - "POST /node/69bf2084a85a0f2cbb32e0c7 HTTP/1.0" 202 Accepted 2026-03-23 22:49:47,102 - lava_callback - INFO - Starting async job submit for node 69bf2084a85a0f2cbb32e0c7 2026-03-23 22:49:47,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:49:47,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2084a85a0f2cbb32e0c7 HTTP/1.1" 200 None 2026-03-23 22:49:47,121 - lava_callback - DEBUG - Processing node 69bf2084a85a0f2cbb32e0c7: baseline-arm64-baylibre 2026-03-23 22:49:47,121 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2084a85a0f2cbb32e0c7 2026-03-23 22:49:47,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:49:47,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2084a85a0f2cbb32e0c7 HTTP/1.1" 200 None 2026-03-23 22:49:47,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:49:47,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:49:47,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:49:47,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2084a85a0f2cbb32e0c7 HTTP/1.1" 200 None 2026-03-23 22:49:47,180 - lava_callback - ERROR - Error processing callback for node 69bf2084a85a0f2cbb32e0c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38302 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:55:47,485 - lava_callback - INFO - Received callback for node 69bf21eea85a0f2cbb32e12f INFO: 172.19.0.1:38312 - "POST /node/69bf21eea85a0f2cbb32e12f HTTP/1.0" 202 Accepted 2026-03-23 22:55:47,490 - lava_callback - INFO - Starting async job submit for node 69bf21eea85a0f2cbb32e12f 2026-03-23 22:55:47,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:55:47,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf21eea85a0f2cbb32e12f HTTP/1.1" 200 None 2026-03-23 22:55:47,534 - lava_callback - DEBUG - Processing node 69bf21eea85a0f2cbb32e12f: baseline-arm64-baylibre 2026-03-23 22:55:47,534 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf21eea85a0f2cbb32e12f 2026-03-23 22:55:47,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:55:47,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf21eea85a0f2cbb32e12f HTTP/1.1" 200 None 2026-03-23 22:55:47,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:55:47,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:55:47,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:55:47,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf21eea85a0f2cbb32e12f HTTP/1.1" 200 None 2026-03-23 22:55:47,640 - lava_callback - ERROR - Error processing callback for node 69bf21eea85a0f2cbb32e12f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46248 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:58:07,543 - lava_callback - INFO - Received callback for node 69bf227ea85a0f2cbb32e145 INFO: 172.19.0.1:46260 - "POST /node/69bf227ea85a0f2cbb32e145 HTTP/1.0" 202 Accepted 2026-03-23 22:58:07,549 - lava_callback - INFO - Starting async job submit for node 69bf227ea85a0f2cbb32e145 2026-03-23 22:58:07,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:58:07,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf227ea85a0f2cbb32e145 HTTP/1.1" 200 None 2026-03-23 22:58:07,580 - lava_callback - DEBUG - Processing node 69bf227ea85a0f2cbb32e145: baseline-arm64-baylibre 2026-03-23 22:58:07,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf227ea85a0f2cbb32e145 2026-03-23 22:58:07,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:58:07,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf227ea85a0f2cbb32e145 HTTP/1.1" 200 None 2026-03-23 22:58:07,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:58:07,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 22:58:07,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:58:07,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf227ea85a0f2cbb32e145 HTTP/1.1" 200 None 2026-03-23 22:58:07,661 - lava_callback - ERROR - Error processing callback for node 69bf227ea85a0f2cbb32e145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46790 - "GET / HTTP/1.0" 200 OK 2026-03-23 22:59:27,603 - lava_callback - INFO - Received callback for node 69bf22c3a85a0f2cbb32e14e INFO: 172.19.0.1:46804 - "POST /node/69bf22c3a85a0f2cbb32e14e HTTP/1.0" 202 Accepted 2026-03-23 22:59:27,609 - lava_callback - INFO - Starting async job submit for node 69bf22c3a85a0f2cbb32e14e 2026-03-23 22:59:27,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:59:27,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf22c3a85a0f2cbb32e14e HTTP/1.1" 200 None 2026-03-23 22:59:27,656 - lava_callback - DEBUG - Processing node 69bf22c3a85a0f2cbb32e14e: baseline-arm64-baylibre 2026-03-23 22:59:27,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf22c3a85a0f2cbb32e14e 2026-03-23 22:59:27,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:59:27,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf22c3a85a0f2cbb32e14e HTTP/1.1" 200 None 2026-03-23 22:59:27,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:59:27,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 22:59:27,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 22:59:27,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf22c3a85a0f2cbb32e14e HTTP/1.1" 200 None 2026-03-23 22:59:27,718 - lava_callback - ERROR - Error processing callback for node 69bf22c3a85a0f2cbb32e14e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49088 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:00:47,748 - lava_callback - INFO - Received callback for node 69bf230da85a0f2cbb32e15b INFO: 172.19.0.1:49094 - "POST /node/69bf230da85a0f2cbb32e15b HTTP/1.0" 202 Accepted 2026-03-23 23:00:47,754 - lava_callback - INFO - Starting async job submit for node 69bf230da85a0f2cbb32e15b 2026-03-23 23:00:47,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:00:47,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf230da85a0f2cbb32e15b HTTP/1.1" 200 None 2026-03-23 23:00:47,771 - lava_callback - DEBUG - Processing node 69bf230da85a0f2cbb32e15b: baseline-arm64-baylibre 2026-03-23 23:00:47,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf230da85a0f2cbb32e15b 2026-03-23 23:00:47,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:00:47,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf230da85a0f2cbb32e15b HTTP/1.1" 200 None 2026-03-23 23:00:47,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:00:47,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:00:47,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:00:47,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf230da85a0f2cbb32e15b HTTP/1.1" 200 None 2026-03-23 23:00:47,827 - lava_callback - ERROR - Error processing callback for node 69bf230da85a0f2cbb32e15b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55254 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:01:47,625 - lava_callback - INFO - Received callback for node 69bf2356a85a0f2cbb32e161 INFO: 172.19.0.1:55262 - "POST /node/69bf2356a85a0f2cbb32e161 HTTP/1.0" 202 Accepted 2026-03-23 23:01:47,631 - lava_callback - INFO - Starting async job submit for node 69bf2356a85a0f2cbb32e161 2026-03-23 23:01:47,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:01:47,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2356a85a0f2cbb32e161 HTTP/1.1" 200 None 2026-03-23 23:01:47,647 - lava_callback - DEBUG - Processing node 69bf2356a85a0f2cbb32e161: baseline-arm64-baylibre 2026-03-23 23:01:47,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2356a85a0f2cbb32e161 2026-03-23 23:01:47,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:01:47,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2356a85a0f2cbb32e161 HTTP/1.1" 200 None 2026-03-23 23:01:47,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:01:47,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:01:47,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:01:47,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2356a85a0f2cbb32e161 HTTP/1.1" 200 None 2026-03-23 23:01:47,708 - lava_callback - ERROR - Error processing callback for node 69bf2356a85a0f2cbb32e161: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44788 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:03:07,750 - lava_callback - INFO - Received callback for node 69bf23a0a85a0f2cbb32e16e INFO: 172.19.0.1:44800 - "POST /node/69bf23a0a85a0f2cbb32e16e HTTP/1.0" 202 Accepted 2026-03-23 23:03:07,756 - lava_callback - INFO - Starting async job submit for node 69bf23a0a85a0f2cbb32e16e 2026-03-23 23:03:07,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:03:07,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf23a0a85a0f2cbb32e16e HTTP/1.1" 200 None 2026-03-23 23:03:07,782 - lava_callback - DEBUG - Processing node 69bf23a0a85a0f2cbb32e16e: baseline-arm64-baylibre 2026-03-23 23:03:07,782 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf23a0a85a0f2cbb32e16e 2026-03-23 23:03:07,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:03:07,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf23a0a85a0f2cbb32e16e HTTP/1.1" 200 None 2026-03-23 23:03:07,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:03:07,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:03:07,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:03:07,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf23a0a85a0f2cbb32e16e HTTP/1.1" 200 None 2026-03-23 23:03:07,841 - lava_callback - ERROR - Error processing callback for node 69bf23a0a85a0f2cbb32e16e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43698 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:04:27,793 - lava_callback - INFO - Received callback for node 69bf23e8a85a0f2cbb32e177 INFO: 172.19.0.1:43702 - "POST /node/69bf23e8a85a0f2cbb32e177 HTTP/1.0" 202 Accepted 2026-03-23 23:04:27,798 - lava_callback - INFO - Starting async job submit for node 69bf23e8a85a0f2cbb32e177 2026-03-23 23:04:27,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:04:27,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf23e8a85a0f2cbb32e177 HTTP/1.1" 200 None 2026-03-23 23:04:27,827 - lava_callback - DEBUG - Processing node 69bf23e8a85a0f2cbb32e177: baseline-arm64-baylibre 2026-03-23 23:04:27,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf23e8a85a0f2cbb32e177 2026-03-23 23:04:27,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:04:27,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf23e8a85a0f2cbb32e177 HTTP/1.1" 200 None 2026-03-23 23:04:27,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:04:27,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:04:27,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:04:27,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf23e8a85a0f2cbb32e177 HTTP/1.1" 200 None 2026-03-23 23:04:27,915 - lava_callback - ERROR - Error processing callback for node 69bf23e8a85a0f2cbb32e177: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38092 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:05:27,827 - lava_callback - INFO - Received callback for node 69bf2431a85a0f2cbb32e185 INFO: 172.19.0.1:38100 - "POST /node/69bf2431a85a0f2cbb32e185 HTTP/1.0" 202 Accepted 2026-03-23 23:05:27,835 - lava_callback - INFO - Starting async job submit for node 69bf2431a85a0f2cbb32e185 2026-03-23 23:05:27,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:05:27,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2431a85a0f2cbb32e185 HTTP/1.1" 200 None 2026-03-23 23:05:27,851 - lava_callback - DEBUG - Processing node 69bf2431a85a0f2cbb32e185: baseline-arm64-baylibre 2026-03-23 23:05:27,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2431a85a0f2cbb32e185 2026-03-23 23:05:27,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:05:27,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2431a85a0f2cbb32e185 HTTP/1.1" 200 None 2026-03-23 23:05:27,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:05:27,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:05:27,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:05:27,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2431a85a0f2cbb32e185 HTTP/1.1" 200 None 2026-03-23 23:05:27,937 - lava_callback - ERROR - Error processing callback for node 69bf2431a85a0f2cbb32e185: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60344 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:06:48,044 - lava_callback - INFO - Received callback for node 69bf2477a85a0f2cbb32e193 INFO: 172.19.0.1:60350 - "POST /node/69bf2477a85a0f2cbb32e193 HTTP/1.0" 202 Accepted 2026-03-23 23:06:48,050 - lava_callback - INFO - Starting async job submit for node 69bf2477a85a0f2cbb32e193 2026-03-23 23:06:48,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:06:48,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2477a85a0f2cbb32e193 HTTP/1.1" 200 None 2026-03-23 23:06:48,065 - lava_callback - DEBUG - Processing node 69bf2477a85a0f2cbb32e193: baseline-arm64-baylibre 2026-03-23 23:06:48,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2477a85a0f2cbb32e193 2026-03-23 23:06:48,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:06:48,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2477a85a0f2cbb32e193 HTTP/1.1" 200 None 2026-03-23 23:06:48,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:06:48,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:06:48,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:06:48,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2477a85a0f2cbb32e193 HTTP/1.1" 200 None 2026-03-23 23:06:48,121 - lava_callback - ERROR - Error processing callback for node 69bf2477a85a0f2cbb32e193: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57612 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:08:10,997 - lava_callback - INFO - Received callback for node 69bf24c8a85a0f2cbb32e1a5 INFO: 172.19.0.1:35684 - "POST /node/69bf24c8a85a0f2cbb32e1a5 HTTP/1.0" 202 Accepted 2026-03-23 23:08:11,004 - lava_callback - INFO - Starting async job submit for node 69bf24c8a85a0f2cbb32e1a5 2026-03-23 23:08:11,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:08:11,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf24c8a85a0f2cbb32e1a5 HTTP/1.1" 200 None 2026-03-23 23:08:11,027 - lava_callback - DEBUG - Processing node 69bf24c8a85a0f2cbb32e1a5: baseline-arm64-clabbe 2026-03-23 23:08:11,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf24c8a85a0f2cbb32e1a5 2026-03-23 23:08:11,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:08:11,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf24c8a85a0f2cbb32e1a5 HTTP/1.1" 200 None 2026-03-23 23:08:11,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:08:11,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:08:11,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:08:11,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf24c8a85a0f2cbb32e1a5 HTTP/1.1" 200 None 2026-03-23 23:08:11,105 - lava_callback - ERROR - Error processing callback for node 69bf24c8a85a0f2cbb32e1a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59546 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:09:10,994 - lava_callback - INFO - Received callback for node 69bf2511a85a0f2cbb32e1ae INFO: 172.19.0.1:47634 - "POST /node/69bf2511a85a0f2cbb32e1ae HTTP/1.0" 202 Accepted 2026-03-23 23:09:10,999 - lava_callback - INFO - Starting async job submit for node 69bf2511a85a0f2cbb32e1ae 2026-03-23 23:09:11,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:09:11,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2511a85a0f2cbb32e1ae HTTP/1.1" 200 None 2026-03-23 23:09:11,018 - lava_callback - DEBUG - Processing node 69bf2511a85a0f2cbb32e1ae: baseline-arm64-clabbe 2026-03-23 23:09:11,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2511a85a0f2cbb32e1ae 2026-03-23 23:09:11,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:09:11,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2511a85a0f2cbb32e1ae HTTP/1.1" 200 None 2026-03-23 23:09:11,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:09:11,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:09:11,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:09:11,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2511a85a0f2cbb32e1ae HTTP/1.1" 200 None 2026-03-23 23:09:11,088 - lava_callback - ERROR - Error processing callback for node 69bf2511a85a0f2cbb32e1ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57936 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:10:31,103 - lava_callback - INFO - Received callback for node 69bf255ba85a0f2cbb32e1be INFO: 172.19.0.1:43374 - "POST /node/69bf255ba85a0f2cbb32e1be HTTP/1.0" 202 Accepted 2026-03-23 23:10:31,108 - lava_callback - INFO - Starting async job submit for node 69bf255ba85a0f2cbb32e1be 2026-03-23 23:10:31,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:10:31,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf255ba85a0f2cbb32e1be HTTP/1.1" 200 None 2026-03-23 23:10:31,129 - lava_callback - DEBUG - Processing node 69bf255ba85a0f2cbb32e1be: baseline-arm64-clabbe 2026-03-23 23:10:31,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf255ba85a0f2cbb32e1be 2026-03-23 23:10:31,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:10:31,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf255ba85a0f2cbb32e1be HTTP/1.1" 200 None 2026-03-23 23:10:31,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:10:31,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:10:31,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:10:31,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf255ba85a0f2cbb32e1be HTTP/1.1" 200 None 2026-03-23 23:10:31,196 - lava_callback - ERROR - Error processing callback for node 69bf255ba85a0f2cbb32e1be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48004 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:11:51,157 - lava_callback - INFO - Received callback for node 69bf25a4a85a0f2cbb32e1c7 INFO: 172.19.0.1:59614 - "POST /node/69bf25a4a85a0f2cbb32e1c7 HTTP/1.0" 202 Accepted 2026-03-23 23:11:51,163 - lava_callback - INFO - Starting async job submit for node 69bf25a4a85a0f2cbb32e1c7 2026-03-23 23:11:51,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:11:51,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf25a4a85a0f2cbb32e1c7 HTTP/1.1" 200 None 2026-03-23 23:11:51,182 - lava_callback - DEBUG - Processing node 69bf25a4a85a0f2cbb32e1c7: baseline-arm64-clabbe 2026-03-23 23:11:51,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf25a4a85a0f2cbb32e1c7 2026-03-23 23:11:51,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:11:51,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf25a4a85a0f2cbb32e1c7 HTTP/1.1" 200 None 2026-03-23 23:11:51,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:11:51,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:11:51,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:11:51,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf25a4a85a0f2cbb32e1c7 HTTP/1.1" 200 None 2026-03-23 23:11:51,305 - lava_callback - ERROR - Error processing callback for node 69bf25a4a85a0f2cbb32e1c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60222 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:12:51,206 - lava_callback - INFO - Received callback for node 69bf25eda85a0f2cbb32e1d1 INFO: 172.19.0.1:53332 - "POST /node/69bf25eda85a0f2cbb32e1d1 HTTP/1.0" 202 Accepted 2026-03-23 23:12:51,212 - lava_callback - INFO - Starting async job submit for node 69bf25eda85a0f2cbb32e1d1 2026-03-23 23:12:51,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:12:51,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf25eda85a0f2cbb32e1d1 HTTP/1.1" 200 None 2026-03-23 23:12:51,228 - lava_callback - DEBUG - Processing node 69bf25eda85a0f2cbb32e1d1: baseline-arm64-clabbe 2026-03-23 23:12:51,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf25eda85a0f2cbb32e1d1 2026-03-23 23:12:51,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:12:51,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf25eda85a0f2cbb32e1d1 HTTP/1.1" 200 None 2026-03-23 23:12:51,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:12:51,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:12:51,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:12:51,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf25eda85a0f2cbb32e1d1 HTTP/1.1" 200 None 2026-03-23 23:12:51,315 - lava_callback - ERROR - Error processing callback for node 69bf25eda85a0f2cbb32e1d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45630 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:14:11,307 - lava_callback - INFO - Received callback for node 69bf2635a85a0f2cbb32e1df INFO: 172.19.0.1:40746 - "POST /node/69bf2635a85a0f2cbb32e1df HTTP/1.0" 202 Accepted 2026-03-23 23:14:11,313 - lava_callback - INFO - Starting async job submit for node 69bf2635a85a0f2cbb32e1df 2026-03-23 23:14:11,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:14:11,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2635a85a0f2cbb32e1df HTTP/1.1" 200 None 2026-03-23 23:14:11,330 - lava_callback - DEBUG - Processing node 69bf2635a85a0f2cbb32e1df: baseline-arm64-clabbe 2026-03-23 23:14:11,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2635a85a0f2cbb32e1df 2026-03-23 23:14:11,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:14:11,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2635a85a0f2cbb32e1df HTTP/1.1" 200 None 2026-03-23 23:14:11,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:14:11,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4e4a85a0f2cbb32a746 HTTP/1.1" 200 None 2026-03-23 23:14:11,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:14:11,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2635a85a0f2cbb32e1df HTTP/1.1" 200 None 2026-03-23 23:14:11,392 - lava_callback - ERROR - Error processing callback for node 69bf2635a85a0f2cbb32e1df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56852 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:16:08,545 - lava_callback - INFO - Received callback for node 69bf26b0a85a0f2cbb32e204 INFO: 172.19.0.1:56864 - "POST /node/69bf26b0a85a0f2cbb32e204 HTTP/1.0" 202 Accepted 2026-03-23 23:16:08,553 - lava_callback - INFO - Starting async job submit for node 69bf26b0a85a0f2cbb32e204 2026-03-23 23:16:08,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:08,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf26b0a85a0f2cbb32e204 HTTP/1.1" 200 None 2026-03-23 23:16:08,578 - lava_callback - DEBUG - Processing node 69bf26b0a85a0f2cbb32e204: baseline-arm-baylibre 2026-03-23 23:16:08,578 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf26b0a85a0f2cbb32e204 2026-03-23 23:16:08,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:08,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf26b0a85a0f2cbb32e204 HTTP/1.1" 200 None 2026-03-23 23:16:08,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:08,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:16:08,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:08,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf26b0a85a0f2cbb32e204 HTTP/1.1" 200 None 2026-03-23 23:16:08,642 - lava_callback - ERROR - Error processing callback for node 69bf26b0a85a0f2cbb32e204: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53072 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:16:48,415 - lava_callback - INFO - Received callback for node 69bf26d4a85a0f2cbb32e210 INFO: 172.19.0.1:53080 - "POST /node/69bf26d4a85a0f2cbb32e210 HTTP/1.0" 202 Accepted 2026-03-23 23:16:48,421 - lava_callback - INFO - Starting async job submit for node 69bf26d4a85a0f2cbb32e210 2026-03-23 23:16:48,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:48,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf26d4a85a0f2cbb32e210 HTTP/1.1" 200 None 2026-03-23 23:16:48,442 - lava_callback - DEBUG - Processing node 69bf26d4a85a0f2cbb32e210: baseline-arm-baylibre 2026-03-23 23:16:48,443 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf26d4a85a0f2cbb32e210 2026-03-23 23:16:48,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:48,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf26d4a85a0f2cbb32e210 HTTP/1.1" 200 None 2026-03-23 23:16:48,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:48,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:16:48,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:16:48,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf26d4a85a0f2cbb32e210 HTTP/1.1" 200 None 2026-03-23 23:16:48,517 - lava_callback - ERROR - Error processing callback for node 69bf26d4a85a0f2cbb32e210: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53424 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:17:28,449 - lava_callback - INFO - Received callback for node 69bf26faa85a0f2cbb32e21c INFO: 172.19.0.1:53426 - "POST /node/69bf26faa85a0f2cbb32e21c HTTP/1.0" 202 Accepted 2026-03-23 23:17:28,455 - lava_callback - INFO - Starting async job submit for node 69bf26faa85a0f2cbb32e21c 2026-03-23 23:17:28,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:17:28,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf26faa85a0f2cbb32e21c HTTP/1.1" 200 None 2026-03-23 23:17:28,470 - lava_callback - DEBUG - Processing node 69bf26faa85a0f2cbb32e21c: baseline-arm-baylibre 2026-03-23 23:17:28,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf26faa85a0f2cbb32e21c 2026-03-23 23:17:28,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:17:28,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf26faa85a0f2cbb32e21c HTTP/1.1" 200 None 2026-03-23 23:17:28,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:17:28,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:17:28,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:17:28,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf26faa85a0f2cbb32e21c HTTP/1.1" 200 None 2026-03-23 23:17:28,533 - lava_callback - ERROR - Error processing callback for node 69bf26faa85a0f2cbb32e21c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48040 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:20:51,496 - lava_callback - INFO - Received callback for node 69bf27cca85a0f2cbb32e263 INFO: 172.19.0.1:36616 - "POST /node/69bf27cca85a0f2cbb32e263 HTTP/1.0" 202 Accepted 2026-03-23 23:20:51,502 - lava_callback - INFO - Starting async job submit for node 69bf27cca85a0f2cbb32e263 2026-03-23 23:20:51,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:20:51,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf27cca85a0f2cbb32e263 HTTP/1.1" 200 None 2026-03-23 23:20:51,518 - lava_callback - DEBUG - Processing node 69bf27cca85a0f2cbb32e263: baseline-arm-clabbe 2026-03-23 23:20:51,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf27cca85a0f2cbb32e263 2026-03-23 23:20:51,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:20:51,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf27cca85a0f2cbb32e263 HTTP/1.1" 200 None 2026-03-23 23:20:51,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:20:51,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:20:51,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:20:51,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf27cca85a0f2cbb32e263 HTTP/1.1" 200 None 2026-03-23 23:20:51,577 - lava_callback - ERROR - Error processing callback for node 69bf27cca85a0f2cbb32e263: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49806 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:21:31,499 - lava_callback - INFO - Received callback for node 69bf27f0a85a0f2cbb32e278 INFO: 172.19.0.1:45558 - "POST /node/69bf27f0a85a0f2cbb32e278 HTTP/1.0" 202 Accepted 2026-03-23 23:21:31,504 - lava_callback - INFO - Starting async job submit for node 69bf27f0a85a0f2cbb32e278 2026-03-23 23:21:31,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:21:31,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf27f0a85a0f2cbb32e278 HTTP/1.1" 200 None 2026-03-23 23:21:31,521 - lava_callback - DEBUG - Processing node 69bf27f0a85a0f2cbb32e278: baseline-arm-clabbe 2026-03-23 23:21:31,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf27f0a85a0f2cbb32e278 2026-03-23 23:21:31,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:21:31,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf27f0a85a0f2cbb32e278 HTTP/1.1" 200 None 2026-03-23 23:21:31,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:21:31,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:21:31,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:21:31,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf27f0a85a0f2cbb32e278 HTTP/1.1" 200 None 2026-03-23 23:21:31,577 - lava_callback - ERROR - Error processing callback for node 69bf27f0a85a0f2cbb32e278: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59776 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:22:11,558 - lava_callback - INFO - Received callback for node 69bf2814a85a0f2cbb32e280 INFO: 172.19.0.1:45114 - "POST /node/69bf2814a85a0f2cbb32e280 HTTP/1.0" 202 Accepted 2026-03-23 23:22:11,563 - lava_callback - INFO - Starting async job submit for node 69bf2814a85a0f2cbb32e280 2026-03-23 23:22:11,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:11,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2814a85a0f2cbb32e280 HTTP/1.1" 200 None 2026-03-23 23:22:11,579 - lava_callback - DEBUG - Processing node 69bf2814a85a0f2cbb32e280: baseline-arm-clabbe 2026-03-23 23:22:11,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2814a85a0f2cbb32e280 2026-03-23 23:22:11,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:11,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2814a85a0f2cbb32e280 HTTP/1.1" 200 None 2026-03-23 23:22:11,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:11,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:22:11,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:11,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2814a85a0f2cbb32e280 HTTP/1.1" 200 None 2026-03-23 23:22:11,644 - lava_callback - ERROR - Error processing callback for node 69bf2814a85a0f2cbb32e280: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44628 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:22:51,582 - lava_callback - INFO - Received callback for node 69bf2837a85a0f2cbb32e28d INFO: 172.19.0.1:34308 - "POST /node/69bf2837a85a0f2cbb32e28d HTTP/1.0" 202 Accepted 2026-03-23 23:22:51,587 - lava_callback - INFO - Starting async job submit for node 69bf2837a85a0f2cbb32e28d 2026-03-23 23:22:51,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:51,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2837a85a0f2cbb32e28d HTTP/1.1" 200 None 2026-03-23 23:22:51,609 - lava_callback - DEBUG - Processing node 69bf2837a85a0f2cbb32e28d: baseline-arm-clabbe 2026-03-23 23:22:51,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2837a85a0f2cbb32e28d 2026-03-23 23:22:51,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:51,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2837a85a0f2cbb32e28d HTTP/1.1" 200 None 2026-03-23 23:22:51,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:51,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:22:51,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:22:51,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2837a85a0f2cbb32e28d HTTP/1.1" 200 None 2026-03-23 23:22:51,671 - lava_callback - ERROR - Error processing callback for node 69bf2837a85a0f2cbb32e28d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34320 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:23:04,673 - lava_callback - INFO - Received callback for node 69c1acd42b2b51e9ad97b2b0 INFO: 172.19.0.1:52396 - "POST /node/69c1acd42b2b51e9ad97b2b0 HTTP/1.0" 202 Accepted 2026-03-23 23:23:04,680 - lava_callback - INFO - Starting async job submit for node 69c1acd42b2b51e9ad97b2b0 2026-03-23 23:23:04,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:04,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1acd42b2b51e9ad97b2b0 HTTP/1.1" 200 None 2026-03-23 23:23:04,719 - lava_callback - DEBUG - Processing node 69c1acd42b2b51e9ad97b2b0: baseline-arm64 2026-03-23 23:23:05,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 23:23:05,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 23:23:05,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1acd42b2b51e9ad97b2b0/log.txt.gz 2026-03-23 23:23:05,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 23:23:05,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 23:23:05,925 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1acd42b2b51e9ad97b2b0/lava-logs.yaml 2026-03-23 23:23:05,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 23:23:06,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 23:23:06,096 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69c1acd42b2b51e9ad97b2b0/lava_callback.json.gz 2026-03-23 23:23:06,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:06,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1acd42b2b51e9ad97b2b0 HTTP/1.1" 200 None 2026-03-23 23:23:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:06,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 23:23:06,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:06,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1acd42b2b51e9ad97b2b0 HTTP/1.1" 200 None 2026-03-23 23:23:06,266 - lava_callback - INFO - Completed processing callback for node 69c1acd42b2b51e9ad97b2b0 INFO: 172.19.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52414 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:23:11,653 - lava_callback - INFO - Received callback for node 69bf285aa85a0f2cbb32e29b INFO: 172.19.0.1:58830 - "POST /node/69bf285aa85a0f2cbb32e29b HTTP/1.0" 202 Accepted 2026-03-23 23:23:11,659 - lava_callback - INFO - Starting async job submit for node 69bf285aa85a0f2cbb32e29b 2026-03-23 23:23:11,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:11,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf285aa85a0f2cbb32e29b HTTP/1.1" 200 None 2026-03-23 23:23:11,679 - lava_callback - DEBUG - Processing node 69bf285aa85a0f2cbb32e29b: baseline-arm-clabbe 2026-03-23 23:23:11,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf285aa85a0f2cbb32e29b 2026-03-23 23:23:11,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:11,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf285aa85a0f2cbb32e29b HTTP/1.1" 200 None 2026-03-23 23:23:11,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:11,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bec4d5a85a0f2cbb32a731 HTTP/1.1" 200 None 2026-03-23 23:23:11,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:11,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf285aa85a0f2cbb32e29b HTTP/1.1" 200 None 2026-03-23 23:23:11,733 - lava_callback - ERROR - Error processing callback for node 69bf285aa85a0f2cbb32e29b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58842 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:23:24,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:23:24,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50496 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:24:08,736 - lava_callback - INFO - Received callback for node 69bf2883a85a0f2cbb32e2a9 INFO: 172.19.0.1:50506 - "POST /node/69bf2883a85a0f2cbb32e2a9 HTTP/1.0" 202 Accepted 2026-03-23 23:24:08,741 - lava_callback - INFO - Starting async job submit for node 69bf2883a85a0f2cbb32e2a9 2026-03-23 23:24:08,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:24:08,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2883a85a0f2cbb32e2a9 HTTP/1.1" 200 None 2026-03-23 23:24:08,760 - lava_callback - DEBUG - Processing node 69bf2883a85a0f2cbb32e2a9: baseline-arm64-baylibre 2026-03-23 23:24:08,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2883a85a0f2cbb32e2a9 2026-03-23 23:24:08,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:24:08,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2883a85a0f2cbb32e2a9 HTTP/1.1" 200 None 2026-03-23 23:24:08,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:24:08,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:24:08,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:24:08,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2883a85a0f2cbb32e2a9 HTTP/1.1" 200 None 2026-03-23 23:24:08,830 - lava_callback - ERROR - Error processing callback for node 69bf2883a85a0f2cbb32e2a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59204 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:25:08,778 - lava_callback - INFO - Received callback for node 69bf28cea85a0f2cbb32e2b3 INFO: 172.19.0.1:59208 - "POST /node/69bf28cea85a0f2cbb32e2b3 HTTP/1.0" 202 Accepted 2026-03-23 23:25:08,784 - lava_callback - INFO - Starting async job submit for node 69bf28cea85a0f2cbb32e2b3 2026-03-23 23:25:08,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:25:08,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf28cea85a0f2cbb32e2b3 HTTP/1.1" 200 None 2026-03-23 23:25:08,811 - lava_callback - DEBUG - Processing node 69bf28cea85a0f2cbb32e2b3: baseline-arm64-baylibre 2026-03-23 23:25:08,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf28cea85a0f2cbb32e2b3 2026-03-23 23:25:08,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:25:08,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf28cea85a0f2cbb32e2b3 HTTP/1.1" 200 None 2026-03-23 23:25:08,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:25:08,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:25:08,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:25:08,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf28cea85a0f2cbb32e2b3 HTTP/1.1" 200 None 2026-03-23 23:25:08,870 - lava_callback - ERROR - Error processing callback for node 69bf28cea85a0f2cbb32e2b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38010 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:26:31,803 - lava_callback - INFO - Received callback for node 69bf291da85a0f2cbb32e2c2 INFO: 172.19.0.1:53330 - "POST /node/69bf291da85a0f2cbb32e2c2 HTTP/1.0" 202 Accepted 2026-03-23 23:26:31,809 - lava_callback - INFO - Starting async job submit for node 69bf291da85a0f2cbb32e2c2 2026-03-23 23:26:31,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:26:31,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf291da85a0f2cbb32e2c2 HTTP/1.1" 200 None 2026-03-23 23:26:31,830 - lava_callback - DEBUG - Processing node 69bf291da85a0f2cbb32e2c2: baseline-arm64-clabbe 2026-03-23 23:26:31,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf291da85a0f2cbb32e2c2 2026-03-23 23:26:31,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:26:31,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf291da85a0f2cbb32e2c2 HTTP/1.1" 200 None 2026-03-23 23:26:31,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:26:31,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:26:31,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:26:31,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf291da85a0f2cbb32e2c2 HTTP/1.1" 200 None 2026-03-23 23:26:31,895 - lava_callback - ERROR - Error processing callback for node 69bf291da85a0f2cbb32e2c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58132 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:27:51,868 - lava_callback - INFO - Received callback for node 69bf2967a85a0f2cbb32e2c9 INFO: 172.19.0.1:48278 - "POST /node/69bf2967a85a0f2cbb32e2c9 HTTP/1.0" 202 Accepted 2026-03-23 23:27:51,873 - lava_callback - INFO - Starting async job submit for node 69bf2967a85a0f2cbb32e2c9 2026-03-23 23:27:51,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:27:51,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2967a85a0f2cbb32e2c9 HTTP/1.1" 200 None 2026-03-23 23:27:51,889 - lava_callback - DEBUG - Processing node 69bf2967a85a0f2cbb32e2c9: baseline-arm64-clabbe 2026-03-23 23:27:51,890 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2967a85a0f2cbb32e2c9 2026-03-23 23:27:51,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:27:51,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2967a85a0f2cbb32e2c9 HTTP/1.1" 200 None 2026-03-23 23:27:51,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:27:51,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:27:51,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:27:51,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2967a85a0f2cbb32e2c9 HTTP/1.1" 200 None 2026-03-23 23:27:51,946 - lava_callback - ERROR - Error processing callback for node 69bf2967a85a0f2cbb32e2c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37946 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:30:09,139 - lava_callback - INFO - Received callback for node 69bf29f1a85a0f2cbb32e2dc INFO: 172.19.0.1:37960 - "POST /node/69bf29f1a85a0f2cbb32e2dc HTTP/1.0" 202 Accepted 2026-03-23 23:30:09,144 - lava_callback - INFO - Starting async job submit for node 69bf29f1a85a0f2cbb32e2dc 2026-03-23 23:30:09,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:30:09,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf29f1a85a0f2cbb32e2dc HTTP/1.1" 200 None 2026-03-23 23:30:09,161 - lava_callback - DEBUG - Processing node 69bf29f1a85a0f2cbb32e2dc: baseline-arm64-baylibre 2026-03-23 23:30:09,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf29f1a85a0f2cbb32e2dc 2026-03-23 23:30:09,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:30:09,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf29f1a85a0f2cbb32e2dc HTTP/1.1" 200 None 2026-03-23 23:30:09,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:30:09,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:30:09,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:30:09,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf29f1a85a0f2cbb32e2dc HTTP/1.1" 200 None 2026-03-23 23:30:09,239 - lava_callback - ERROR - Error processing callback for node 69bf29f1a85a0f2cbb32e2dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49830 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:31:31,985 - lava_callback - INFO - Received callback for node 69bf2a42a85a0f2cbb32e2e4 INFO: 172.19.0.1:55766 - "POST /node/69bf2a42a85a0f2cbb32e2e4 HTTP/1.0" 202 Accepted 2026-03-23 23:31:31,991 - lava_callback - INFO - Starting async job submit for node 69bf2a42a85a0f2cbb32e2e4 2026-03-23 23:31:31,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:31:32,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2a42a85a0f2cbb32e2e4 HTTP/1.1" 200 None 2026-03-23 23:31:32,018 - lava_callback - DEBUG - Processing node 69bf2a42a85a0f2cbb32e2e4: baseline-arm64-clabbe 2026-03-23 23:31:32,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2a42a85a0f2cbb32e2e4 2026-03-23 23:31:32,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:31:32,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2a42a85a0f2cbb32e2e4 HTTP/1.1" 200 None 2026-03-23 23:31:32,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:31:32,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:31:32,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:31:32,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2a42a85a0f2cbb32e2e4 HTTP/1.1" 200 None 2026-03-23 23:31:32,109 - lava_callback - ERROR - Error processing callback for node 69bf2a42a85a0f2cbb32e2e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43174 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:32:32,028 - lava_callback - INFO - Received callback for node 69bf2a8da85a0f2cbb32e2f5 INFO: 172.19.0.1:46778 - "POST /node/69bf2a8da85a0f2cbb32e2f5 HTTP/1.0" 202 Accepted 2026-03-23 23:32:32,033 - lava_callback - INFO - Starting async job submit for node 69bf2a8da85a0f2cbb32e2f5 2026-03-23 23:32:32,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:32:32,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2a8da85a0f2cbb32e2f5 HTTP/1.1" 200 None 2026-03-23 23:32:32,052 - lava_callback - DEBUG - Processing node 69bf2a8da85a0f2cbb32e2f5: baseline-arm64-clabbe 2026-03-23 23:32:32,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2a8da85a0f2cbb32e2f5 2026-03-23 23:32:32,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:32:32,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2a8da85a0f2cbb32e2f5 HTTP/1.1" 200 None 2026-03-23 23:32:32,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:32:32,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:32:32,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:32:32,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2a8da85a0f2cbb32e2f5 HTTP/1.1" 200 None 2026-03-23 23:32:32,112 - lava_callback - ERROR - Error processing callback for node 69bf2a8da85a0f2cbb32e2f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38816 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:33:52,084 - lava_callback - INFO - Received callback for node 69bf2ad7a85a0f2cbb32e2fb INFO: 172.19.0.1:49354 - "POST /node/69bf2ad7a85a0f2cbb32e2fb HTTP/1.0" 202 Accepted 2026-03-23 23:33:52,089 - lava_callback - INFO - Starting async job submit for node 69bf2ad7a85a0f2cbb32e2fb 2026-03-23 23:33:52,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:33:52,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2ad7a85a0f2cbb32e2fb HTTP/1.1" 200 None 2026-03-23 23:33:52,104 - lava_callback - DEBUG - Processing node 69bf2ad7a85a0f2cbb32e2fb: baseline-arm64-clabbe 2026-03-23 23:33:52,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2ad7a85a0f2cbb32e2fb 2026-03-23 23:33:52,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:33:52,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2ad7a85a0f2cbb32e2fb HTTP/1.1" 200 None 2026-03-23 23:33:52,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:33:52,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:33:52,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:33:52,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2ad7a85a0f2cbb32e2fb HTTP/1.1" 200 None 2026-03-23 23:33:52,181 - lava_callback - ERROR - Error processing callback for node 69bf2ad7a85a0f2cbb32e2fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34908 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:34:52,984 - lava_callback - INFO - Received callback for node 69c1af2f2b2b51e9ad97b30b INFO: 172.19.0.1:58448 - "POST /node/69c1af2f2b2b51e9ad97b30b HTTP/1.0" 202 Accepted 2026-03-23 23:34:52,990 - lava_callback - INFO - Starting async job submit for node 69c1af2f2b2b51e9ad97b30b 2026-03-23 23:34:53,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:34:53,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1af2f2b2b51e9ad97b30b HTTP/1.1" 200 None 2026-03-23 23:34:53,031 - lava_callback - DEBUG - Processing node 69c1af2f2b2b51e9ad97b30b: baseline-nfs-arm64 2026-03-23 23:34:53,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 23:34:53,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 23:34:53,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1af2f2b2b51e9ad97b30b/log.txt.gz 2026-03-23 23:34:53,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 23:34:54,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 23:34:54,235 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1af2f2b2b51e9ad97b30b/lava-logs.yaml 2026-03-23 23:34:54,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-23 23:34:54,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-23 23:34:54,421 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69c1af2f2b2b51e9ad97b30b/lava_callback.json.gz 2026-03-23 23:34:54,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:34:54,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1af2f2b2b51e9ad97b30b HTTP/1.1" 200 None 2026-03-23 23:34:54,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:34:54,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c1679b2b2b51e9ad977955 HTTP/1.1" 200 None 2026-03-23 23:34:54,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:34:54,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69c1af2f2b2b51e9ad97b30b HTTP/1.1" 200 None 2026-03-23 23:34:54,553 - lava_callback - INFO - Completed processing callback for node 69c1af2f2b2b51e9ad97b30b INFO: 172.19.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58660 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:35:09,355 - lava_callback - INFO - Received callback for node 69bf2b1ba85a0f2cbb32e30b INFO: 172.19.0.1:58676 - "POST /node/69bf2b1ba85a0f2cbb32e30b HTTP/1.0" 202 Accepted 2026-03-23 23:35:09,360 - lava_callback - INFO - Starting async job submit for node 69bf2b1ba85a0f2cbb32e30b 2026-03-23 23:35:09,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:35:09,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2b1ba85a0f2cbb32e30b HTTP/1.1" 200 None 2026-03-23 23:35:09,377 - lava_callback - DEBUG - Processing node 69bf2b1ba85a0f2cbb32e30b: baseline-arm64-baylibre 2026-03-23 23:35:09,377 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2b1ba85a0f2cbb32e30b 2026-03-23 23:35:09,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:35:09,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2b1ba85a0f2cbb32e30b HTTP/1.1" 200 None 2026-03-23 23:35:09,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:35:09,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:35:09,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:35:09,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2b1ba85a0f2cbb32e30b HTTP/1.1" 200 None 2026-03-23 23:35:09,440 - lava_callback - ERROR - Error processing callback for node 69bf2b1ba85a0f2cbb32e30b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51080 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:35:24,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:35:24,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32980 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:36:32,170 - lava_callback - INFO - Received callback for node 69bf2b6aa85a0f2cbb32e312 INFO: 172.19.0.1:58048 - "POST /node/69bf2b6aa85a0f2cbb32e312 HTTP/1.0" 202 Accepted 2026-03-23 23:36:32,175 - lava_callback - INFO - Starting async job submit for node 69bf2b6aa85a0f2cbb32e312 2026-03-23 23:36:32,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:36:32,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2b6aa85a0f2cbb32e312 HTTP/1.1" 200 None 2026-03-23 23:36:32,192 - lava_callback - DEBUG - Processing node 69bf2b6aa85a0f2cbb32e312: baseline-arm64-clabbe 2026-03-23 23:36:32,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2b6aa85a0f2cbb32e312 2026-03-23 23:36:32,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:36:32,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2b6aa85a0f2cbb32e312 HTTP/1.1" 200 None 2026-03-23 23:36:32,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:36:32,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:36:32,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:36:32,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2b6aa85a0f2cbb32e312 HTTP/1.1" 200 None 2026-03-23 23:36:32,258 - lava_callback - ERROR - Error processing callback for node 69bf2b6aa85a0f2cbb32e312: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52710 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:37:32,242 - lava_callback - INFO - Received callback for node 69bf2bb3a85a0f2cbb32e322 INFO: 172.19.0.1:42452 - "POST /node/69bf2bb3a85a0f2cbb32e322 HTTP/1.0" 202 Accepted 2026-03-23 23:37:32,249 - lava_callback - INFO - Starting async job submit for node 69bf2bb3a85a0f2cbb32e322 2026-03-23 23:37:32,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:37:32,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2bb3a85a0f2cbb32e322 HTTP/1.1" 200 None 2026-03-23 23:37:32,269 - lava_callback - DEBUG - Processing node 69bf2bb3a85a0f2cbb32e322: baseline-arm64-clabbe 2026-03-23 23:37:32,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2bb3a85a0f2cbb32e322 2026-03-23 23:37:32,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:37:32,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2bb3a85a0f2cbb32e322 HTTP/1.1" 200 None 2026-03-23 23:37:32,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:37:32,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:37:32,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:37:32,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2bb3a85a0f2cbb32e322 HTTP/1.1" 200 None 2026-03-23 23:37:32,335 - lava_callback - ERROR - Error processing callback for node 69bf2bb3a85a0f2cbb32e322: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60216 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:38:52,322 - lava_callback - INFO - Received callback for node 69bf2bfca85a0f2cbb32e329 INFO: 172.19.0.1:57048 - "POST /node/69bf2bfca85a0f2cbb32e329 HTTP/1.0" 202 Accepted 2026-03-23 23:38:52,328 - lava_callback - INFO - Starting async job submit for node 69bf2bfca85a0f2cbb32e329 2026-03-23 23:38:52,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:38:52,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2bfca85a0f2cbb32e329 HTTP/1.1" 200 None 2026-03-23 23:38:52,344 - lava_callback - DEBUG - Processing node 69bf2bfca85a0f2cbb32e329: baseline-arm64-clabbe 2026-03-23 23:38:52,344 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2bfca85a0f2cbb32e329 2026-03-23 23:38:52,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:38:52,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2bfca85a0f2cbb32e329 HTTP/1.1" 200 None 2026-03-23 23:38:52,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:38:52,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:38:52,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:38:52,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2bfca85a0f2cbb32e329 HTTP/1.1" 200 None 2026-03-23 23:38:52,407 - lava_callback - ERROR - Error processing callback for node 69bf2bfca85a0f2cbb32e329: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59666 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:40:12,311 - lava_callback - INFO - Received callback for node 69bf2c46a85a0f2cbb32e340 INFO: 172.19.0.1:55636 - "POST /node/69bf2c46a85a0f2cbb32e340 HTTP/1.0" 202 Accepted 2026-03-23 23:40:12,316 - lava_callback - INFO - Starting async job submit for node 69bf2c46a85a0f2cbb32e340 2026-03-23 23:40:12,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:40:12,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2c46a85a0f2cbb32e340 HTTP/1.1" 200 None 2026-03-23 23:40:12,332 - lava_callback - DEBUG - Processing node 69bf2c46a85a0f2cbb32e340: baseline-arm64-clabbe 2026-03-23 23:40:12,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2c46a85a0f2cbb32e340 2026-03-23 23:40:12,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:40:12,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2c46a85a0f2cbb32e340 HTTP/1.1" 200 None 2026-03-23 23:40:12,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:40:12,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:40:12,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:40:12,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2c46a85a0f2cbb32e340 HTTP/1.1" 200 None 2026-03-23 23:40:12,400 - lava_callback - ERROR - Error processing callback for node 69bf2c46a85a0f2cbb32e340: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38370 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:41:12,381 - lava_callback - INFO - Received callback for node 69bf2c91a85a0f2cbb32e347 INFO: 172.19.0.1:44450 - "POST /node/69bf2c91a85a0f2cbb32e347 HTTP/1.0" 202 Accepted 2026-03-23 23:41:12,387 - lava_callback - INFO - Starting async job submit for node 69bf2c91a85a0f2cbb32e347 2026-03-23 23:41:12,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:41:12,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2c91a85a0f2cbb32e347 HTTP/1.1" 200 None 2026-03-23 23:41:12,404 - lava_callback - DEBUG - Processing node 69bf2c91a85a0f2cbb32e347: baseline-arm64-clabbe 2026-03-23 23:41:12,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2c91a85a0f2cbb32e347 2026-03-23 23:41:12,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:41:12,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2c91a85a0f2cbb32e347 HTTP/1.1" 200 None 2026-03-23 23:41:12,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:41:12,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:41:12,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:41:12,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2c91a85a0f2cbb32e347 HTTP/1.1" 200 None 2026-03-23 23:41:12,461 - lava_callback - ERROR - Error processing callback for node 69bf2c91a85a0f2cbb32e347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52030 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:42:32,434 - lava_callback - INFO - Received callback for node 69bf2cdba85a0f2cbb32e350 INFO: 172.19.0.1:54830 - "POST /node/69bf2cdba85a0f2cbb32e350 HTTP/1.0" 202 Accepted 2026-03-23 23:42:32,440 - lava_callback - INFO - Starting async job submit for node 69bf2cdba85a0f2cbb32e350 2026-03-23 23:42:32,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:42:32,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2cdba85a0f2cbb32e350 HTTP/1.1" 200 None 2026-03-23 23:42:32,455 - lava_callback - DEBUG - Processing node 69bf2cdba85a0f2cbb32e350: baseline-arm64-clabbe 2026-03-23 23:42:32,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2cdba85a0f2cbb32e350 2026-03-23 23:42:32,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:42:32,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2cdba85a0f2cbb32e350 HTTP/1.1" 200 None 2026-03-23 23:42:32,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:42:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:42:32,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:42:32,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2cdba85a0f2cbb32e350 HTTP/1.1" 200 None 2026-03-23 23:42:32,514 - lava_callback - ERROR - Error processing callback for node 69bf2cdba85a0f2cbb32e350: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43532 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:43:52,608 - lava_callback - INFO - Received callback for node 69bf2d26a85a0f2cbb32e35d INFO: 172.19.0.1:36116 - "POST /node/69bf2d26a85a0f2cbb32e35d HTTP/1.0" 202 Accepted 2026-03-23 23:43:52,613 - lava_callback - INFO - Starting async job submit for node 69bf2d26a85a0f2cbb32e35d 2026-03-23 23:43:52,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:43:52,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2d26a85a0f2cbb32e35d HTTP/1.1" 200 None 2026-03-23 23:43:52,629 - lava_callback - DEBUG - Processing node 69bf2d26a85a0f2cbb32e35d: baseline-arm64-clabbe 2026-03-23 23:43:52,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2d26a85a0f2cbb32e35d 2026-03-23 23:43:52,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:43:52,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2d26a85a0f2cbb32e35d HTTP/1.1" 200 None 2026-03-23 23:43:52,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:43:52,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:43:52,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:43:52,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2d26a85a0f2cbb32e35d HTTP/1.1" 200 None 2026-03-23 23:43:52,689 - lava_callback - ERROR - Error processing callback for node 69bf2d26a85a0f2cbb32e35d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36028 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:44:52,468 - lava_callback - INFO - Received callback for node 69bf2d70a85a0f2cbb32e366 INFO: 172.19.0.1:43326 - "POST /node/69bf2d70a85a0f2cbb32e366 HTTP/1.0" 202 Accepted 2026-03-23 23:44:52,473 - lava_callback - INFO - Starting async job submit for node 69bf2d70a85a0f2cbb32e366 2026-03-23 23:44:52,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:44:52,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2d70a85a0f2cbb32e366 HTTP/1.1" 200 None 2026-03-23 23:44:52,508 - lava_callback - DEBUG - Processing node 69bf2d70a85a0f2cbb32e366: baseline-arm64-clabbe 2026-03-23 23:44:52,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2d70a85a0f2cbb32e366 2026-03-23 23:44:52,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:44:52,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2d70a85a0f2cbb32e366 HTTP/1.1" 200 None 2026-03-23 23:44:52,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:44:52,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:44:52,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:44:52,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2d70a85a0f2cbb32e366 HTTP/1.1" 200 None 2026-03-23 23:44:52,595 - lava_callback - ERROR - Error processing callback for node 69bf2d70a85a0f2cbb32e366: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43344 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:46:12,678 - lava_callback - INFO - Received callback for node 69bf2dbaa85a0f2cbb32e374 INFO: 172.19.0.1:38006 - "POST /node/69bf2dbaa85a0f2cbb32e374 HTTP/1.0" 202 Accepted 2026-03-23 23:46:12,683 - lava_callback - INFO - Starting async job submit for node 69bf2dbaa85a0f2cbb32e374 2026-03-23 23:46:12,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:46:12,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2dbaa85a0f2cbb32e374 HTTP/1.1" 200 None 2026-03-23 23:46:12,701 - lava_callback - DEBUG - Processing node 69bf2dbaa85a0f2cbb32e374: baseline-arm64-clabbe 2026-03-23 23:46:12,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2dbaa85a0f2cbb32e374 2026-03-23 23:46:12,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:46:12,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2dbaa85a0f2cbb32e374 HTTP/1.1" 200 None 2026-03-23 23:46:12,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:46:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:46:12,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:46:12,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2dbaa85a0f2cbb32e374 HTTP/1.1" 200 None 2026-03-23 23:46:12,771 - lava_callback - ERROR - Error processing callback for node 69bf2dbaa85a0f2cbb32e374: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60900 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:47:32,604 - lava_callback - INFO - Received callback for node 69bf2e04a85a0f2cbb32e37c INFO: 172.19.0.1:58386 - "POST /node/69bf2e04a85a0f2cbb32e37c HTTP/1.0" 202 Accepted 2026-03-23 23:47:32,610 - lava_callback - INFO - Starting async job submit for node 69bf2e04a85a0f2cbb32e37c 2026-03-23 23:47:32,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:47:32,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2e04a85a0f2cbb32e37c HTTP/1.1" 200 None 2026-03-23 23:47:32,637 - lava_callback - DEBUG - Processing node 69bf2e04a85a0f2cbb32e37c: baseline-arm64-clabbe 2026-03-23 23:47:32,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2e04a85a0f2cbb32e37c 2026-03-23 23:47:32,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:47:32,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2e04a85a0f2cbb32e37c HTTP/1.1" 200 None 2026-03-23 23:47:32,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:47:32,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:47:32,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:47:32,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2e04a85a0f2cbb32e37c HTTP/1.1" 200 None 2026-03-23 23:47:32,747 - lava_callback - ERROR - Error processing callback for node 69bf2e04a85a0f2cbb32e37c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44346 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:48:52,726 - lava_callback - INFO - Received callback for node 69bf2e4ea85a0f2cbb32e38e INFO: 172.19.0.1:35388 - "POST /node/69bf2e4ea85a0f2cbb32e38e HTTP/1.0" 202 Accepted 2026-03-23 23:48:52,732 - lava_callback - INFO - Starting async job submit for node 69bf2e4ea85a0f2cbb32e38e 2026-03-23 23:48:52,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:48:52,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2e4ea85a0f2cbb32e38e HTTP/1.1" 200 None 2026-03-23 23:48:52,752 - lava_callback - DEBUG - Processing node 69bf2e4ea85a0f2cbb32e38e: baseline-arm64-clabbe 2026-03-23 23:48:52,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2e4ea85a0f2cbb32e38e 2026-03-23 23:48:52,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:48:52,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2e4ea85a0f2cbb32e38e HTTP/1.1" 200 None 2026-03-23 23:48:52,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:48:52,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:48:52,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:48:52,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2e4ea85a0f2cbb32e38e HTTP/1.1" 200 None 2026-03-23 23:48:52,843 - lava_callback - ERROR - Error processing callback for node 69bf2e4ea85a0f2cbb32e38e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51754 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:49:52,745 - lava_callback - INFO - Received callback for node 69bf2e99a85a0f2cbb32e39b INFO: 172.19.0.1:39908 - "POST /node/69bf2e99a85a0f2cbb32e39b HTTP/1.0" 202 Accepted 2026-03-23 23:49:52,751 - lava_callback - INFO - Starting async job submit for node 69bf2e99a85a0f2cbb32e39b 2026-03-23 23:49:52,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:49:52,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2e99a85a0f2cbb32e39b HTTP/1.1" 200 None 2026-03-23 23:49:52,780 - lava_callback - DEBUG - Processing node 69bf2e99a85a0f2cbb32e39b: baseline-arm64-clabbe 2026-03-23 23:49:52,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2e99a85a0f2cbb32e39b 2026-03-23 23:49:52,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:49:52,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2e99a85a0f2cbb32e39b HTTP/1.1" 200 None 2026-03-23 23:49:52,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:49:52,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:49:52,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:49:52,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2e99a85a0f2cbb32e39b HTTP/1.1" 200 None 2026-03-23 23:49:52,836 - lava_callback - ERROR - Error processing callback for node 69bf2e99a85a0f2cbb32e39b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54530 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:51:12,814 - lava_callback - INFO - Received callback for node 69bf2ee4a85a0f2cbb32e3af INFO: 172.19.0.1:51478 - "POST /node/69bf2ee4a85a0f2cbb32e3af HTTP/1.0" 202 Accepted 2026-03-23 23:51:12,820 - lava_callback - INFO - Starting async job submit for node 69bf2ee4a85a0f2cbb32e3af 2026-03-23 23:51:12,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:51:12,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2ee4a85a0f2cbb32e3af HTTP/1.1" 200 None 2026-03-23 23:51:12,836 - lava_callback - DEBUG - Processing node 69bf2ee4a85a0f2cbb32e3af: baseline-arm64-clabbe 2026-03-23 23:51:12,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2ee4a85a0f2cbb32e3af 2026-03-23 23:51:12,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:51:12,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2ee4a85a0f2cbb32e3af HTTP/1.1" 200 None 2026-03-23 23:51:12,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:51:12,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-23 23:51:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:51:12,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2ee4a85a0f2cbb32e3af HTTP/1.1" 200 None 2026-03-23 23:51:12,897 - lava_callback - ERROR - Error processing callback for node 69bf2ee4a85a0f2cbb32e3af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39970 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:52:10,451 - lava_callback - INFO - Received callback for node 69bf2f1ca85a0f2cbb32e3bd INFO: 172.19.0.1:43812 - "POST /node/69bf2f1ca85a0f2cbb32e3bd HTTP/1.0" 202 Accepted 2026-03-23 23:52:10,456 - lava_callback - INFO - Starting async job submit for node 69bf2f1ca85a0f2cbb32e3bd 2026-03-23 23:52:10,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:52:10,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2f1ca85a0f2cbb32e3bd HTTP/1.1" 200 None 2026-03-23 23:52:10,472 - lava_callback - DEBUG - Processing node 69bf2f1ca85a0f2cbb32e3bd: baseline-arm-baylibre 2026-03-23 23:52:10,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2f1ca85a0f2cbb32e3bd 2026-03-23 23:52:10,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:52:10,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2f1ca85a0f2cbb32e3bd HTTP/1.1" 200 None 2026-03-23 23:52:10,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:52:10,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:52:10,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:52:10,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2f1ca85a0f2cbb32e3bd HTTP/1.1" 200 None 2026-03-23 23:52:10,523 - lava_callback - ERROR - Error processing callback for node 69bf2f1ca85a0f2cbb32e3bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38494 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:54:32,958 - lava_callback - INFO - Received callback for node 69bf2faca85a0f2cbb32e3f5 INFO: 172.19.0.1:34404 - "POST /node/69bf2faca85a0f2cbb32e3f5 HTTP/1.0" 202 Accepted 2026-03-23 23:54:32,965 - lava_callback - INFO - Starting async job submit for node 69bf2faca85a0f2cbb32e3f5 2026-03-23 23:54:32,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:54:32,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2faca85a0f2cbb32e3f5 HTTP/1.1" 200 None 2026-03-23 23:54:32,988 - lava_callback - DEBUG - Processing node 69bf2faca85a0f2cbb32e3f5: baseline-arm-clabbe 2026-03-23 23:54:32,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2faca85a0f2cbb32e3f5 2026-03-23 23:54:32,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:54:33,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2faca85a0f2cbb32e3f5 HTTP/1.1" 200 None 2026-03-23 23:54:33,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:54:33,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:54:33,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:54:33,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2faca85a0f2cbb32e3f5 HTTP/1.1" 200 None 2026-03-23 23:54:33,050 - lava_callback - ERROR - Error processing callback for node 69bf2faca85a0f2cbb32e3f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48548 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:55:32,954 - lava_callback - INFO - Received callback for node 69bf2ff2a85a0f2cbb32e415 INFO: 172.19.0.1:46142 - "POST /node/69bf2ff2a85a0f2cbb32e415 HTTP/1.0" 202 Accepted 2026-03-23 23:55:32,962 - lava_callback - INFO - Starting async job submit for node 69bf2ff2a85a0f2cbb32e415 2026-03-23 23:55:32,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:55:32,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2ff2a85a0f2cbb32e415 HTTP/1.1" 200 None 2026-03-23 23:55:32,990 - lava_callback - DEBUG - Processing node 69bf2ff2a85a0f2cbb32e415: baseline-arm-clabbe 2026-03-23 23:55:32,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf2ff2a85a0f2cbb32e415 2026-03-23 23:55:32,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:55:33,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf2ff2a85a0f2cbb32e415 HTTP/1.1" 200 None 2026-03-23 23:55:33,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:55:33,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:55:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:55:33,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf2ff2a85a0f2cbb32e415 HTTP/1.1" 200 None 2026-03-23 23:55:33,055 - lava_callback - ERROR - Error processing callback for node 69bf2ff2a85a0f2cbb32e415: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41070 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:56:53,102 - lava_callback - INFO - Received callback for node 69bf3038a85a0f2cbb32e432 INFO: 172.19.0.1:37740 - "POST /node/69bf3038a85a0f2cbb32e432 HTTP/1.0" 202 Accepted 2026-03-23 23:56:53,108 - lava_callback - INFO - Starting async job submit for node 69bf3038a85a0f2cbb32e432 2026-03-23 23:56:53,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:56:53,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3038a85a0f2cbb32e432 HTTP/1.1" 200 None 2026-03-23 23:56:53,124 - lava_callback - DEBUG - Processing node 69bf3038a85a0f2cbb32e432: baseline-arm-clabbe 2026-03-23 23:56:53,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf3038a85a0f2cbb32e432 2026-03-23 23:56:53,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:56:53,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3038a85a0f2cbb32e432 HTTP/1.1" 200 None 2026-03-23 23:56:53,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:56:53,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:56:53,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:56:53,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf3038a85a0f2cbb32e432 HTTP/1.1" 200 None 2026-03-23 23:56:53,176 - lava_callback - ERROR - Error processing callback for node 69bf3038a85a0f2cbb32e432: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40502 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:57:33,035 - lava_callback - INFO - Received callback for node 69bf305da85a0f2cbb32e443 INFO: 172.19.0.1:56842 - "POST /node/69bf305da85a0f2cbb32e443 HTTP/1.0" 202 Accepted 2026-03-23 23:57:33,042 - lava_callback - INFO - Starting async job submit for node 69bf305da85a0f2cbb32e443 2026-03-23 23:57:33,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:57:33,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf305da85a0f2cbb32e443 HTTP/1.1" 200 None 2026-03-23 23:57:33,065 - lava_callback - DEBUG - Processing node 69bf305da85a0f2cbb32e443: baseline-arm-clabbe 2026-03-23 23:57:33,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf305da85a0f2cbb32e443 2026-03-23 23:57:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:57:33,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf305da85a0f2cbb32e443 HTTP/1.1" 200 None 2026-03-23 23:57:33,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:57:33,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:57:33,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:57:33,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf305da85a0f2cbb32e443 HTTP/1.1" 200 None 2026-03-23 23:57:33,123 - lava_callback - ERROR - Error processing callback for node 69bf305da85a0f2cbb32e443: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58968 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:58:13,074 - lava_callback - INFO - Received callback for node 69bf3080a85a0f2cbb32e45b INFO: 172.19.0.1:35538 - "POST /node/69bf3080a85a0f2cbb32e45b HTTP/1.0" 202 Accepted 2026-03-23 23:58:13,080 - lava_callback - INFO - Starting async job submit for node 69bf3080a85a0f2cbb32e45b 2026-03-23 23:58:13,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:13,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3080a85a0f2cbb32e45b HTTP/1.1" 200 None 2026-03-23 23:58:13,096 - lava_callback - DEBUG - Processing node 69bf3080a85a0f2cbb32e45b: baseline-arm-clabbe 2026-03-23 23:58:13,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf3080a85a0f2cbb32e45b 2026-03-23 23:58:13,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:13,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3080a85a0f2cbb32e45b HTTP/1.1" 200 None 2026-03-23 23:58:13,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:13,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:58:13,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:13,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf3080a85a0f2cbb32e45b HTTP/1.1" 200 None 2026-03-23 23:58:13,150 - lava_callback - ERROR - Error processing callback for node 69bf3080a85a0f2cbb32e45b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34686 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:58:33,063 - lava_callback - INFO - Received callback for node 69bf30a4a85a0f2cbb32e463 INFO: 172.19.0.1:50110 - "POST /node/69bf30a4a85a0f2cbb32e463 HTTP/1.0" 202 Accepted 2026-03-23 23:58:33,069 - lava_callback - INFO - Starting async job submit for node 69bf30a4a85a0f2cbb32e463 2026-03-23 23:58:33,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:33,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf30a4a85a0f2cbb32e463 HTTP/1.1" 200 None 2026-03-23 23:58:33,086 - lava_callback - DEBUG - Processing node 69bf30a4a85a0f2cbb32e463: baseline-arm-clabbe 2026-03-23 23:58:33,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf30a4a85a0f2cbb32e463 2026-03-23 23:58:33,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:33,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf30a4a85a0f2cbb32e463 HTTP/1.1" 200 None 2026-03-23 23:58:33,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:33,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:58:33,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:58:33,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf30a4a85a0f2cbb32e463 HTTP/1.1" 200 None 2026-03-23 23:58:33,150 - lava_callback - ERROR - Error processing callback for node 69bf30a4a85a0f2cbb32e463: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49564 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:59:13,644 - lava_callback - INFO - Received callback for node 69bf30c8a85a0f2cbb32e472 INFO: 172.19.0.1:44574 - "POST /node/69bf30c8a85a0f2cbb32e472 HTTP/1.0" 202 Accepted 2026-03-23 23:59:13,650 - lava_callback - INFO - Starting async job submit for node 69bf30c8a85a0f2cbb32e472 2026-03-23 23:59:13,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:13,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf30c8a85a0f2cbb32e472 HTTP/1.1" 200 None 2026-03-23 23:59:13,671 - lava_callback - DEBUG - Processing node 69bf30c8a85a0f2cbb32e472: baseline-arm-clabbe 2026-03-23 23:59:13,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf30c8a85a0f2cbb32e472 2026-03-23 23:59:13,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:13,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf30c8a85a0f2cbb32e472 HTTP/1.1" 200 None 2026-03-23 23:59:13,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:13,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:59:13,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:13,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf30c8a85a0f2cbb32e472 HTTP/1.1" 200 None 2026-03-23 23:59:13,748 - lava_callback - ERROR - Error processing callback for node 69bf30c8a85a0f2cbb32e472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53106 - "GET / HTTP/1.0" 200 OK 2026-03-23 23:59:52,977 - lava_callback - INFO - Received callback for node 69bf30eba85a0f2cbb32e481 INFO: 172.19.0.1:37630 - "POST /node/69bf30eba85a0f2cbb32e481 HTTP/1.0" 202 Accepted 2026-03-23 23:59:52,983 - lava_callback - INFO - Starting async job submit for node 69bf30eba85a0f2cbb32e481 2026-03-23 23:59:52,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:53,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf30eba85a0f2cbb32e481 HTTP/1.1" 200 None 2026-03-23 23:59:53,018 - lava_callback - DEBUG - Processing node 69bf30eba85a0f2cbb32e481: baseline-arm-clabbe 2026-03-23 23:59:53,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf30eba85a0f2cbb32e481 2026-03-23 23:59:53,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:53,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf30eba85a0f2cbb32e481 HTTP/1.1" 200 None 2026-03-23 23:59:53,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:53,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-23 23:59:53,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-23 23:59:53,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf30eba85a0f2cbb32e481 HTTP/1.1" 200 None 2026-03-23 23:59:53,080 - lava_callback - ERROR - Error processing callback for node 69bf30eba85a0f2cbb32e481: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38556 - "GET / HTTP/1.0" 200 OK 2026-03-24 00:00:33,205 - lava_callback - INFO - Received callback for node 69bf3111a85a0f2cbb32e490 INFO: 172.19.0.1:49852 - "POST /node/69bf3111a85a0f2cbb32e490 HTTP/1.0" 202 Accepted 2026-03-24 00:00:33,212 - lava_callback - INFO - Starting async job submit for node 69bf3111a85a0f2cbb32e490 2026-03-24 00:00:33,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:00:33,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3111a85a0f2cbb32e490 HTTP/1.1" 200 None 2026-03-24 00:00:33,236 - lava_callback - DEBUG - Processing node 69bf3111a85a0f2cbb32e490: baseline-arm-clabbe 2026-03-24 00:00:33,237 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf3111a85a0f2cbb32e490 2026-03-24 00:00:33,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:00:33,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3111a85a0f2cbb32e490 HTTP/1.1" 200 None 2026-03-24 00:00:33,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:00:33,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-24 00:00:33,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:00:33,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf3111a85a0f2cbb32e490 HTTP/1.1" 200 None 2026-03-24 00:00:33,331 - lava_callback - ERROR - Error processing callback for node 69bf3111a85a0f2cbb32e490: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56054 - "GET / HTTP/1.0" 200 OK 2026-03-24 00:01:13,182 - lava_callback - INFO - Received callback for node 69bf3136a85a0f2cbb32e4a5 INFO: 172.19.0.1:44194 - "POST /node/69bf3136a85a0f2cbb32e4a5 HTTP/1.0" 202 Accepted 2026-03-24 00:01:13,189 - lava_callback - INFO - Starting async job submit for node 69bf3136a85a0f2cbb32e4a5 2026-03-24 00:01:13,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:01:13,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3136a85a0f2cbb32e4a5 HTTP/1.1" 200 None 2026-03-24 00:01:13,211 - lava_callback - DEBUG - Processing node 69bf3136a85a0f2cbb32e4a5: baseline-arm-clabbe 2026-03-24 00:01:13,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bf3136a85a0f2cbb32e4a5 2026-03-24 00:01:13,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:01:13,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bf3136a85a0f2cbb32e4a5 HTTP/1.1" 200 None 2026-03-24 00:01:13,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:01:13,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21a117e5cb936602bc16 HTTP/1.1" 200 None 2026-03-24 00:01:13,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-24 00:01:13,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bf3136a85a0f2cbb32e4a5 HTTP/1.1" 200 None 2026-03-24 00:01:13,305 - lava_callback - ERROR - Error processing callback for node 69bf3136a85a0f2cbb32e4a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]