INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:51942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:14:30,492 - lava_callback - INFO - Received callback for node 69fd2add0c2e97cda07f502b 2026-05-10 00:14:30,499 - lava_callback - INFO - Starting async job submit for node 69fd2add0c2e97cda07f502b INFO: 172.20.0.1:59718 - "POST /node/69fd2add0c2e97cda07f502b HTTP/1.0" 202 Accepted 2026-05-10 00:14:30,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:14:30,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2add0c2e97cda07f502b HTTP/1.1" 200 None 2026-05-10 00:14:30,531 - lava_callback - DEBUG - Processing node 69fd2add0c2e97cda07f502b: baseline-arm-clabbe 2026-05-10 00:14:30,532 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd2add0c2e97cda07f502b 2026-05-10 00:14:30,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:14:30,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2add0c2e97cda07f502b HTTP/1.1" 200 None 2026-05-10 00:14:30,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:14:30,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f77553096243809b569923 HTTP/1.1" 200 None 2026-05-10 00:14:30,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:14:30,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd2add0c2e97cda07f502b HTTP/1.1" 200 None 2026-05-10 00:14:30,578 - lava_callback - ERROR - Error processing callback for node 69fd2add0c2e97cda07f502b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35016 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:35:37,207 - lava_callback - INFO - Received callback for node 69ffd25b8d5045ce94720a9b INFO: 172.20.0.1:35032 - "POST /node/69ffd25b8d5045ce94720a9b HTTP/1.0" 202 Accepted 2026-05-10 00:35:37,213 - lava_callback - INFO - Starting async job submit for node 69ffd25b8d5045ce94720a9b 2026-05-10 00:35:37,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:35:37,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd25b8d5045ce94720a9b HTTP/1.1" 200 None 2026-05-10 00:35:37,255 - lava_callback - DEBUG - Processing node 69ffd25b8d5045ce94720a9b: baseline-arm 2026-05-10 00:35:37,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:35:37,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:35:37,630 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd25b8d5045ce94720a9b/log.txt.gz 2026-05-10 00:35:37,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:35:37,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:35:37,876 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd25b8d5045ce94720a9b/lava-logs.yaml 2026-05-10 00:35:37,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:35:37,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:35:37,990 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd25b8d5045ce94720a9b/lava_callback.json.gz 2026-05-10 00:35:38,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:35:38,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd25b8d5045ce94720a9b HTTP/1.1" 200 None 2026-05-10 00:35:38,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:35:38,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce858d5045ce9471e366 HTTP/1.1" 200 None 2026-05-10 00:35:38,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:35:38,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd25b8d5045ce94720a9b HTTP/1.1" 200 None 2026-05-10 00:35:38,068 - lava_callback - INFO - Completed processing callback for node 69ffd25b8d5045ce94720a9b INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60904 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:36:00,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:36:00,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43744 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:38:33,709 - lava_callback - INFO - Received callback for node 69ffd3688d5045ce94720ac2 INFO: 172.20.0.1:59114 - "POST /node/69ffd3688d5045ce94720ac2 HTTP/1.0" 202 Accepted 2026-05-10 00:38:33,716 - lava_callback - INFO - Starting async job submit for node 69ffd3688d5045ce94720ac2 2026-05-10 00:38:33,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:33,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd3688d5045ce94720ac2 HTTP/1.1" 200 None 2026-05-10 00:38:33,748 - lava_callback - DEBUG - Processing node 69ffd3688d5045ce94720ac2: baseline-x86 2026-05-10 00:38:33,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:38:34,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:38:34,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3688d5045ce94720ac2/log.txt.gz 2026-05-10 00:38:34,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:38:34,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:38:34,318 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3688d5045ce94720ac2/lava-logs.yaml 2026-05-10 00:38:34,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:38:34,407 - lava_callback - INFO - Received callback for node 69ffd36a8d5045ce94720acb 2026-05-10 00:38:34,417 - lava_callback - INFO - Starting async job submit for node 69ffd36a8d5045ce94720acb INFO: 172.20.0.1:59116 - "POST /node/69ffd36a8d5045ce94720acb HTTP/1.0" 202 Accepted 2026-05-10 00:38:34,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:38:34,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:34,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3688d5045ce94720ac2/lava_callback.json.gz 2026-05-10 00:38:34,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:34,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd36a8d5045ce94720acb HTTP/1.1" 200 None 2026-05-10 00:38:34,489 - lava_callback - DEBUG - Processing node 69ffd36a8d5045ce94720acb: baseline-x86 2026-05-10 00:38:34,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd3688d5045ce94720ac2 HTTP/1.1" 200 None 2026-05-10 00:38:34,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:34,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffcea38d5045ce9471e38e HTTP/1.1" 200 None 2026-05-10 00:38:34,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:34,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:38:34,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd3688d5045ce94720ac2 HTTP/1.1" 200 None 2026-05-10 00:38:34,758 - lava_callback - INFO - Completed processing callback for node 69ffd3688d5045ce94720ac2 2026-05-10 00:38:34,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:38:34,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd36a8d5045ce94720acb/log.txt.gz 2026-05-10 00:38:34,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:38:35,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:38:35,201 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd36a8d5045ce94720acb/lava-logs.yaml 2026-05-10 00:38:35,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:38:35,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:38:35,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd36a8d5045ce94720acb/lava_callback.json.gz 2026-05-10 00:38:35,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:35,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd36a8d5045ce94720acb HTTP/1.1" 200 None 2026-05-10 00:38:35,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:35,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffcea38d5045ce9471e38e HTTP/1.1" 200 None 2026-05-10 00:38:35,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:38:35,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd36a8d5045ce94720acb HTTP/1.1" 200 None 2026-05-10 00:38:35,409 - lava_callback - INFO - Completed processing callback for node 69ffd36a8d5045ce94720acb INFO: 172.20.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60790 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:39:00,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:00,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41750 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:39:46,066 - lava_callback - INFO - Received callback for node 69ffd3698d5045ce94720ac8 INFO: 172.20.0.1:38724 - "POST /node/69ffd3698d5045ce94720ac8 HTTP/1.0" 202 Accepted 2026-05-10 00:39:46,072 - lava_callback - INFO - Starting async job submit for node 69ffd3698d5045ce94720ac8 2026-05-10 00:39:46,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:46,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd3698d5045ce94720ac8 HTTP/1.1" 200 None 2026-05-10 00:39:46,117 - lava_callback - DEBUG - Processing node 69ffd3698d5045ce94720ac8: baseline-x86 2026-05-10 00:39:46,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:39:46,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:39:46,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3698d5045ce94720ac8/log.txt.gz INFO: 172.20.0.1:38730 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:39:46,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:39:46,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:39:46,784 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3698d5045ce94720ac8/lava-logs.yaml 2026-05-10 00:39:46,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:39:46,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:39:46,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3698d5045ce94720ac8/lava_callback.json.gz 2026-05-10 00:39:46,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:46,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd3698d5045ce94720ac8 HTTP/1.1" 200 None 2026-05-10 00:39:46,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:46,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffcea38d5045ce9471e38e HTTP/1.1" 200 None 2026-05-10 00:39:46,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:46,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd3698d5045ce94720ac8 HTTP/1.1" 200 None 2026-05-10 00:39:46,962 - lava_callback - INFO - Completed processing callback for node 69ffd3698d5045ce94720ac8 INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:39:56,892 - lava_callback - INFO - Received callback for node 69ffd3688d5045ce94720ac5 INFO: 172.20.0.1:37862 - "POST /node/69ffd3688d5045ce94720ac5 HTTP/1.0" 202 Accepted 2026-05-10 00:39:56,898 - lava_callback - INFO - Starting async job submit for node 69ffd3688d5045ce94720ac5 2026-05-10 00:39:56,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:56,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd3688d5045ce94720ac5 HTTP/1.1" 200 None 2026-05-10 00:39:56,948 - lava_callback - DEBUG - Processing node 69ffd3688d5045ce94720ac5: baseline-x86 2026-05-10 00:39:57,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:39:57,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:39:57,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3688d5045ce94720ac5/log.txt.gz 2026-05-10 00:39:57,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:39:57,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:39:57,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3688d5045ce94720ac5/lava-logs.yaml 2026-05-10 00:39:57,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:39:58,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:39:58,036 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ffd3688d5045ce94720ac5/lava_callback.json.gz 2026-05-10 00:39:58,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:58,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd3688d5045ce94720ac5 HTTP/1.1" 200 None 2026-05-10 00:39:58,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:58,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffcea38d5045ce9471e38e HTTP/1.1" 200 None 2026-05-10 00:39:58,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:39:58,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd3688d5045ce94720ac5 HTTP/1.1" 200 None 2026-05-10 00:39:58,116 - lava_callback - INFO - Completed processing callback for node 69ffd3688d5045ce94720ac5 2026-05-10 00:40:00,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:40:00,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36860 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:41:30,405 - lava_callback - INFO - Received callback for node 69ffd4288d5045ce94720b28 INFO: 172.20.0.1:50814 - "POST /node/69ffd4288d5045ce94720b28 HTTP/1.0" 202 Accepted 2026-05-10 00:41:30,412 - lava_callback - INFO - Starting async job submit for node 69ffd4288d5045ce94720b28 2026-05-10 00:41:30,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:30,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4288d5045ce94720b28 HTTP/1.1" 200 None 2026-05-10 00:41:30,430 - lava_callback - DEBUG - Processing node 69ffd4288d5045ce94720b28: baseline-arm 2026-05-10 00:41:30,435 - lava_callback - WARNING - Failed to upload log 2026-05-10 00:41:30,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:41:30,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:41:30,527 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4288d5045ce94720b28/lava-logs.yaml 2026-05-10 00:41:30,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:41:30,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:41:30,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4288d5045ce94720b28/lava_callback.json.gz 2026-05-10 00:41:30,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:30,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4288d5045ce94720b28 HTTP/1.1" 200 None 2026-05-10 00:41:30,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:30,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:41:30,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:30,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4288d5045ce94720b28 HTTP/1.1" 200 None 2026-05-10 00:41:30,692 - lava_callback - INFO - Completed processing callback for node 69ffd4288d5045ce94720b28 2026-05-10 00:41:33,881 - lava_callback - INFO - Received callback for node 69ffd4278d5045ce94720b25 INFO: 172.20.0.1:50820 - "POST /node/69ffd4278d5045ce94720b25 HTTP/1.0" 202 Accepted 2026-05-10 00:41:33,894 - lava_callback - INFO - Starting async job submit for node 69ffd4278d5045ce94720b25 2026-05-10 00:41:33,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:33,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4278d5045ce94720b25 HTTP/1.1" 200 None 2026-05-10 00:41:33,952 - lava_callback - DEBUG - Processing node 69ffd4278d5045ce94720b25: baseline-arm 2026-05-10 00:41:33,968 - lava_callback - WARNING - Failed to upload log 2026-05-10 00:41:33,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:41:34,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:41:34,142 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4278d5045ce94720b25/lava-logs.yaml 2026-05-10 00:41:34,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:41:34,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:41:34,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4278d5045ce94720b25/lava_callback.json.gz 2026-05-10 00:41:34,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:34,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4278d5045ce94720b25 HTTP/1.1" 200 None 2026-05-10 00:41:34,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:34,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:41:34,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:41:34,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4278d5045ce94720b25 HTTP/1.1" 200 None 2026-05-10 00:41:34,319 - lava_callback - INFO - Completed processing callback for node 69ffd4278d5045ce94720b25 INFO: 172.20.0.1:50836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49938 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:42:00,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:00,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 00:42:03,404 - lava_callback - INFO - Received callback for node 69ffd42a8d5045ce94720b31 INFO: 172.20.0.1:47352 - "POST /node/69ffd42a8d5045ce94720b31 HTTP/1.0" 202 Accepted 2026-05-10 00:42:03,450 - lava_callback - INFO - Starting async job submit for node 69ffd42a8d5045ce94720b31 2026-05-10 00:42:03,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:03,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd42a8d5045ce94720b31 HTTP/1.1" 200 None 2026-05-10 00:42:03,482 - lava_callback - DEBUG - Processing node 69ffd42a8d5045ce94720b31: baseline-arm 2026-05-10 00:42:03,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:03,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:03,724 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd42a8d5045ce94720b31/log.txt.gz 2026-05-10 00:42:03,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:03,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:03,939 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd42a8d5045ce94720b31/lava-logs.yaml 2026-05-10 00:42:03,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:04,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:04,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd42a8d5045ce94720b31/lava_callback.json.gz 2026-05-10 00:42:04,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:04,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd42a8d5045ce94720b31 HTTP/1.1" 200 None 2026-05-10 00:42:04,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:04,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:42:04,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:04,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd42a8d5045ce94720b31 HTTP/1.1" 200 None 2026-05-10 00:42:04,223 - lava_callback - INFO - Completed processing callback for node 69ffd42a8d5045ce94720b31 INFO: 172.20.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56112 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:42:30,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:30,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 00:42:33,745 - lava_callback - INFO - Received callback for node 69ffd4298d5045ce94720b2e INFO: 172.20.0.1:56720 - "POST /node/69ffd4298d5045ce94720b2e HTTP/1.0" 202 Accepted 2026-05-10 00:42:33,755 - lava_callback - INFO - Starting async job submit for node 69ffd4298d5045ce94720b2e 2026-05-10 00:42:33,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:33,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4298d5045ce94720b2e HTTP/1.1" 200 None 2026-05-10 00:42:33,793 - lava_callback - DEBUG - Processing node 69ffd4298d5045ce94720b2e: baseline-arm 2026-05-10 00:42:34,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:34,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:34,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4298d5045ce94720b2e/log.txt.gz 2026-05-10 00:42:34,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:34,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:34,429 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4298d5045ce94720b2e/lava-logs.yaml 2026-05-10 00:42:34,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:34,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:34,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4298d5045ce94720b2e/lava_callback.json.gz 2026-05-10 00:42:34,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:34,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4298d5045ce94720b2e HTTP/1.1" 200 None 2026-05-10 00:42:34,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:34,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:42:34,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:34,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4298d5045ce94720b2e HTTP/1.1" 200 None 2026-05-10 00:42:34,677 - lava_callback - INFO - Completed processing callback for node 69ffd4298d5045ce94720b2e 2026-05-10 00:42:36,450 - lava_callback - INFO - Received callback for node 69fd3170197af08e45fc55aa INFO: 172.20.0.1:56728 - "POST /node/69fd3170197af08e45fc55aa HTTP/1.0" 202 Accepted 2026-05-10 00:42:36,455 - lava_callback - INFO - Starting async job submit for node 69fd3170197af08e45fc55aa 2026-05-10 00:42:36,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:36,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3170197af08e45fc55aa HTTP/1.1" 200 None 2026-05-10 00:42:36,473 - lava_callback - DEBUG - Processing node 69fd3170197af08e45fc55aa: baseline-arm-baylibre 2026-05-10 00:42:36,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3170197af08e45fc55aa 2026-05-10 00:42:36,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:36,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3170197af08e45fc55aa HTTP/1.1" 200 None 2026-05-10 00:42:36,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:36,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 00:42:36,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:56732 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:42:36,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3170197af08e45fc55aa HTTP/1.1" 200 None 2026-05-10 00:42:36,524 - lava_callback - ERROR - Error processing callback for node 69fd3170197af08e45fc55aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:42:37,504 - lava_callback - INFO - Received callback for node 69ffd4378d5045ce94720b55 INFO: 172.20.0.1:56734 - "POST /node/69ffd4378d5045ce94720b55 HTTP/1.0" 202 Accepted 2026-05-10 00:42:37,510 - lava_callback - INFO - Starting async job submit for node 69ffd4378d5045ce94720b55 2026-05-10 00:42:37,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:37,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4378d5045ce94720b55 HTTP/1.1" 200 None 2026-05-10 00:42:37,546 - lava_callback - DEBUG - Processing node 69ffd4378d5045ce94720b55: baseline-arm-broonie 2026-05-10 00:42:37,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:37,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:37,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4378d5045ce94720b55/log.txt.gz 2026-05-10 00:42:38,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:38,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:38,248 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4378d5045ce94720b55/lava-logs.yaml 2026-05-10 00:42:38,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:38,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:38,368 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4378d5045ce94720b55/lava_callback.json.gz 2026-05-10 00:42:38,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:38,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4378d5045ce94720b55 HTTP/1.1" 200 None 2026-05-10 00:42:38,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:38,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:42:38,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:38,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4378d5045ce94720b55 HTTP/1.1" 200 None 2026-05-10 00:42:38,472 - lava_callback - INFO - Completed processing callback for node 69ffd4378d5045ce94720b55 2026-05-10 00:42:39,029 - lava_callback - INFO - Received callback for node 69ffd4388d5045ce94720b58 INFO: 172.20.0.1:56736 - "POST /node/69ffd4388d5045ce94720b58 HTTP/1.0" 202 Accepted 2026-05-10 00:42:39,035 - lava_callback - INFO - Starting async job submit for node 69ffd4388d5045ce94720b58 2026-05-10 00:42:39,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:39,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4388d5045ce94720b58 HTTP/1.1" 200 None 2026-05-10 00:42:39,073 - lava_callback - DEBUG - Processing node 69ffd4388d5045ce94720b58: baseline-arm-broonie 2026-05-10 00:42:39,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:39,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:39,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4388d5045ce94720b58/log.txt.gz 2026-05-10 00:42:39,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:39,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:39,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4388d5045ce94720b58/lava-logs.yaml 2026-05-10 00:42:39,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:39,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:39,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4388d5045ce94720b58/lava_callback.json.gz 2026-05-10 00:42:39,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:39,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4388d5045ce94720b58 HTTP/1.1" 200 None 2026-05-10 00:42:39,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:39,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:42:39,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:39,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4388d5045ce94720b58 HTTP/1.1" 200 None 2026-05-10 00:42:39,868 - lava_callback - INFO - Completed processing callback for node 69ffd4388d5045ce94720b58 INFO: 172.20.0.1:46586 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:42:53,629 - lava_callback - INFO - Received callback for node 69ffd4498d5045ce94720bc5 INFO: 172.20.0.1:46328 - "POST /node/69ffd4498d5045ce94720bc5 HTTP/1.0" 202 Accepted 2026-05-10 00:42:53,635 - lava_callback - INFO - Starting async job submit for node 69ffd4498d5045ce94720bc5 2026-05-10 00:42:53,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:53,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4498d5045ce94720bc5 HTTP/1.1" 200 None 2026-05-10 00:42:53,675 - lava_callback - DEBUG - Processing node 69ffd4498d5045ce94720bc5: baseline-arm-pengutronix 2026-05-10 00:42:53,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:53,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:53,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd4498d5045ce94720bc5/log.txt.gz 2026-05-10 00:42:53,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:54,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:54,124 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd4498d5045ce94720bc5/lava-logs.yaml 2026-05-10 00:42:54,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:54,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:54,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd4498d5045ce94720bc5/lava_callback.json.gz 2026-05-10 00:42:54,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:54,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4498d5045ce94720bc5 HTTP/1.1" 200 None 2026-05-10 00:42:54,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:54,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:42:54,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:54,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4498d5045ce94720bc5 HTTP/1.1" 200 None 2026-05-10 00:42:54,404 - lava_callback - INFO - Completed processing callback for node 69ffd4498d5045ce94720bc5 2026-05-10 00:42:56,089 - lava_callback - INFO - Received callback for node 69ffd4278d5045ce94720b22 INFO: 172.20.0.1:46336 - "POST /node/69ffd4278d5045ce94720b22 HTTP/1.0" 202 Accepted 2026-05-10 00:42:56,095 - lava_callback - INFO - Starting async job submit for node 69ffd4278d5045ce94720b22 2026-05-10 00:42:56,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:56,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4278d5045ce94720b22 HTTP/1.1" 200 None 2026-05-10 00:42:56,137 - lava_callback - DEBUG - Processing node 69ffd4278d5045ce94720b22: baseline-arm 2026-05-10 00:42:56,278 - lava_callback - INFO - Received callback for node 69fd3185197af08e45fc55d4 INFO: 172.20.0.1:46348 - "POST /node/69fd3185197af08e45fc55d4 HTTP/1.0" 202 Accepted 2026-05-10 00:42:56,295 - lava_callback - INFO - Starting async job submit for node 69fd3185197af08e45fc55d4 2026-05-10 00:42:56,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:56,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3185197af08e45fc55d4 HTTP/1.1" 200 None 2026-05-10 00:42:56,418 - lava_callback - DEBUG - Processing node 69fd3185197af08e45fc55d4: baseline-arm-baylibre 2026-05-10 00:42:56,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3185197af08e45fc55d4 2026-05-10 00:42:56,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:56,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:56,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3185197af08e45fc55d4 HTTP/1.1" 200 None 2026-05-10 00:42:56,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:56,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:42:56,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:56,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3185197af08e45fc55d4 HTTP/1.1" 200 None 2026-05-10 00:42:56,483 - lava_callback - ERROR - Error processing callback for node 69fd3185197af08e45fc55d4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46362 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:42:56,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:56,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4278d5045ce94720b22/log.txt.gz 2026-05-10 00:42:56,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:56,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:56,874 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4278d5045ce94720b22/lava-logs.yaml 2026-05-10 00:42:56,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:56,980 - lava_callback - INFO - Received callback for node 69fd3186197af08e45fc55d7 INFO: 172.20.0.1:46374 - "POST /node/69fd3186197af08e45fc55d7 HTTP/1.0" 202 Accepted 2026-05-10 00:42:56,986 - lava_callback - INFO - Starting async job submit for node 69fd3186197af08e45fc55d7 2026-05-10 00:42:56,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:56,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:56,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4278d5045ce94720b22/lava_callback.json.gz 2026-05-10 00:42:57,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3186197af08e45fc55d7 HTTP/1.1" 200 None 2026-05-10 00:42:57,020 - lava_callback - DEBUG - Processing node 69fd3186197af08e45fc55d7: baseline-arm-baylibre 2026-05-10 00:42:57,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3186197af08e45fc55d7 2026-05-10 00:42:57,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4278d5045ce94720b22 HTTP/1.1" 200 None 2026-05-10 00:42:57,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3186197af08e45fc55d7 HTTP/1.1" 200 None 2026-05-10 00:42:57,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:42:57,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:42:57,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3186197af08e45fc55d7 HTTP/1.1" 200 None 2026-05-10 00:42:57,103 - lava_callback - ERROR - Error processing callback for node 69fd3186197af08e45fc55d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:42:57,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4278d5045ce94720b22 HTTP/1.1" 200 None 2026-05-10 00:42:57,125 - lava_callback - INFO - Completed processing callback for node 69ffd4278d5045ce94720b22 2026-05-10 00:42:57,674 - lava_callback - INFO - Received callback for node 69fd3187197af08e45fc55da INFO: 172.20.0.1:46386 - "POST /node/69fd3187197af08e45fc55da HTTP/1.0" 202 Accepted 2026-05-10 00:42:57,679 - lava_callback - INFO - Starting async job submit for node 69fd3187197af08e45fc55da 2026-05-10 00:42:57,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3187197af08e45fc55da HTTP/1.1" 200 None 2026-05-10 00:42:57,697 - lava_callback - DEBUG - Processing node 69fd3187197af08e45fc55da: baseline-arm-baylibre 2026-05-10 00:42:57,698 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3187197af08e45fc55da 2026-05-10 00:42:57,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3187197af08e45fc55da HTTP/1.1" 200 None 2026-05-10 00:42:57,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:42:57,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:57,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3187197af08e45fc55da HTTP/1.1" 200 None 2026-05-10 00:42:57,748 - lava_callback - ERROR - Error processing callback for node 69fd3187197af08e45fc55da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:42:58,377 - lava_callback - INFO - Received callback for node 69fd318a197af08e45fc55e5 INFO: 172.20.0.1:46392 - "POST /node/69fd318a197af08e45fc55e5 HTTP/1.0" 202 Accepted 2026-05-10 00:42:58,386 - lava_callback - INFO - Starting async job submit for node 69fd318a197af08e45fc55e5 2026-05-10 00:42:58,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:58,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318a197af08e45fc55e5 HTTP/1.1" 200 None 2026-05-10 00:42:58,402 - lava_callback - DEBUG - Processing node 69fd318a197af08e45fc55e5: baseline-arm-baylibre 2026-05-10 00:42:58,403 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd318a197af08e45fc55e5 2026-05-10 00:42:58,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:58,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318a197af08e45fc55e5 HTTP/1.1" 200 None 2026-05-10 00:42:58,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:58,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:42:58,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:58,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd318a197af08e45fc55e5 HTTP/1.1" 200 None 2026-05-10 00:42:58,463 - lava_callback - ERROR - Error processing callback for node 69fd318a197af08e45fc55e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:42:59,054 - lava_callback - INFO - Received callback for node 69fd318b197af08e45fc55e8 INFO: 172.20.0.1:46404 - "POST /node/69fd318b197af08e45fc55e8 HTTP/1.0" 202 Accepted 2026-05-10 00:42:59,060 - lava_callback - INFO - Starting async job submit for node 69fd318b197af08e45fc55e8 2026-05-10 00:42:59,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:59,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318b197af08e45fc55e8 HTTP/1.1" 200 None 2026-05-10 00:42:59,075 - lava_callback - DEBUG - Processing node 69fd318b197af08e45fc55e8: baseline-arm-baylibre 2026-05-10 00:42:59,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd318b197af08e45fc55e8 2026-05-10 00:42:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:59,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd318b197af08e45fc55e8 HTTP/1.1" 200 None 2026-05-10 00:42:59,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:59,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:42:59,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:59,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd318b197af08e45fc55e8 HTTP/1.1" 200 None 2026-05-10 00:42:59,132 - lava_callback - ERROR - Error processing callback for node 69fd318b197af08e45fc55e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:42:59,534 - lava_callback - INFO - Received callback for node 69ffd43a8d5045ce94720b5b INFO: 172.20.0.1:46410 - "POST /node/69ffd43a8d5045ce94720b5b HTTP/1.0" 202 Accepted 2026-05-10 00:42:59,540 - lava_callback - INFO - Starting async job submit for node 69ffd43a8d5045ce94720b5b 2026-05-10 00:42:59,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:42:59,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd43a8d5045ce94720b5b HTTP/1.1" 200 None 2026-05-10 00:42:59,583 - lava_callback - DEBUG - Processing node 69ffd43a8d5045ce94720b5b: baseline-arm-broonie 2026-05-10 00:42:59,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:42:59,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:42:59,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd43a8d5045ce94720b5b/log.txt.gz 2026-05-10 00:43:00,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:00,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:00,233 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd43a8d5045ce94720b5b/lava-logs.yaml 2026-05-10 00:43:00,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:00,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:00,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd43a8d5045ce94720b5b/lava_callback.json.gz 2026-05-10 00:43:00,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:00,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd43a8d5045ce94720b5b HTTP/1.1" 200 None 2026-05-10 00:43:00,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:00,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:00,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:00,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd43a8d5045ce94720b5b HTTP/1.1" 200 None 2026-05-10 00:43:00,414 - lava_callback - INFO - Completed processing callback for node 69ffd43a8d5045ce94720b5b 2026-05-10 00:43:00,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:00,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 00:43:05,243 - lava_callback - INFO - Received callback for node 69ffd44d8d5045ce94720bce INFO: 172.20.0.1:33090 - "POST /node/69ffd44d8d5045ce94720bce HTTP/1.0" 202 Accepted 2026-05-10 00:43:05,289 - lava_callback - INFO - Starting async job submit for node 69ffd44d8d5045ce94720bce 2026-05-10 00:43:05,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:05,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd44d8d5045ce94720bce HTTP/1.1" 200 None 2026-05-10 00:43:05,325 - lava_callback - DEBUG - Processing node 69ffd44d8d5045ce94720bce: baseline-arm-pengutronix 2026-05-10 00:43:05,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:05,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:05,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44d8d5045ce94720bce/log.txt.gz 2026-05-10 00:43:05,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:05,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:05,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44d8d5045ce94720bce/lava-logs.yaml 2026-05-10 00:43:05,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:05,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:05,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44d8d5045ce94720bce/lava_callback.json.gz 2026-05-10 00:43:05,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:05,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd44d8d5045ce94720bce HTTP/1.1" 200 None 2026-05-10 00:43:05,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:05,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:05,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:05,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd44d8d5045ce94720bce HTTP/1.1" 200 None 2026-05-10 00:43:05,874 - lava_callback - INFO - Completed processing callback for node 69ffd44d8d5045ce94720bce INFO: 172.20.0.1:33094 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:43:09,352 - lava_callback - INFO - Received callback for node 69ffd44b8d5045ce94720bc8 INFO: 172.20.0.1:33108 - "POST /node/69ffd44b8d5045ce94720bc8 HTTP/1.0" 202 Accepted 2026-05-10 00:43:09,358 - lava_callback - INFO - Starting async job submit for node 69ffd44b8d5045ce94720bc8 2026-05-10 00:43:09,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:09,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd44b8d5045ce94720bc8 HTTP/1.1" 200 None 2026-05-10 00:43:09,392 - lava_callback - DEBUG - Processing node 69ffd44b8d5045ce94720bc8: baseline-arm-pengutronix 2026-05-10 00:43:09,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:09,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:09,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44b8d5045ce94720bc8/log.txt.gz 2026-05-10 00:43:09,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:09,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:09,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44b8d5045ce94720bc8/lava-logs.yaml 2026-05-10 00:43:09,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:09,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:09,979 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44b8d5045ce94720bc8/lava_callback.json.gz 2026-05-10 00:43:09,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:10,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd44b8d5045ce94720bc8 HTTP/1.1" 200 None 2026-05-10 00:43:10,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:10,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:10,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:10,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd44b8d5045ce94720bc8 HTTP/1.1" 200 None 2026-05-10 00:43:10,049 - lava_callback - INFO - Completed processing callback for node 69ffd44b8d5045ce94720bc8 2026-05-10 00:43:11,581 - lava_callback - INFO - Received callback for node 69fd3192197af08e45fc55ff INFO: 172.20.0.1:52326 - "POST /node/69fd3192197af08e45fc55ff HTTP/1.0" 202 Accepted 2026-05-10 00:43:11,587 - lava_callback - INFO - Starting async job submit for node 69fd3192197af08e45fc55ff 2026-05-10 00:43:11,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:11,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3192197af08e45fc55ff HTTP/1.1" 200 None 2026-05-10 00:43:11,602 - lava_callback - DEBUG - Processing node 69fd3192197af08e45fc55ff: baseline-arm-clabbe 2026-05-10 00:43:11,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3192197af08e45fc55ff 2026-05-10 00:43:11,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:11,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3192197af08e45fc55ff HTTP/1.1" 200 None 2026-05-10 00:43:11,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:11,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:43:11,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:11,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3192197af08e45fc55ff HTTP/1.1" 200 None 2026-05-10 00:43:11,647 - lava_callback - ERROR - Error processing callback for node 69fd3192197af08e45fc55ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:43:12,282 - lava_callback - INFO - Received callback for node 69fd319b197af08e45fc5640 INFO: 172.20.0.1:52328 - "POST /node/69fd319b197af08e45fc5640 HTTP/1.0" 202 Accepted 2026-05-10 00:43:12,287 - lava_callback - INFO - Starting async job submit for node 69fd319b197af08e45fc5640 2026-05-10 00:43:12,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:12,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319b197af08e45fc5640 HTTP/1.1" 200 None 2026-05-10 00:43:12,303 - lava_callback - DEBUG - Processing node 69fd319b197af08e45fc5640: baseline-arm-clabbe 2026-05-10 00:43:12,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd319b197af08e45fc5640 2026-05-10 00:43:12,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:12,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319b197af08e45fc5640 HTTP/1.1" 200 None 2026-05-10 00:43:12,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:12,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:43:12,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:12,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd319b197af08e45fc5640 HTTP/1.1" 200 None 2026-05-10 00:43:12,351 - lava_callback - ERROR - Error processing callback for node 69fd319b197af08e45fc5640: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:43:12,996 - lava_callback - INFO - Received callback for node 69fd3197197af08e45fc560d INFO: 172.20.0.1:52334 - "POST /node/69fd3197197af08e45fc560d HTTP/1.0" 202 Accepted 2026-05-10 00:43:13,001 - lava_callback - INFO - Starting async job submit for node 69fd3197197af08e45fc560d 2026-05-10 00:43:13,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3197197af08e45fc560d HTTP/1.1" 200 None 2026-05-10 00:43:13,016 - lava_callback - DEBUG - Processing node 69fd3197197af08e45fc560d: baseline-arm-clabbe 2026-05-10 00:43:13,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3197197af08e45fc560d 2026-05-10 00:43:13,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3197197af08e45fc560d HTTP/1.1" 200 None 2026-05-10 00:43:13,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:43:13,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3197197af08e45fc560d HTTP/1.1" 200 None 2026-05-10 00:43:13,059 - lava_callback - ERROR - Error processing callback for node 69fd3197197af08e45fc560d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:43:13,773 - lava_callback - INFO - Received callback for node 69fd3198197af08e45fc5635 INFO: 172.20.0.1:52344 - "POST /node/69fd3198197af08e45fc5635 HTTP/1.0" 202 Accepted 2026-05-10 00:43:13,780 - lava_callback - INFO - Starting async job submit for node 69fd3198197af08e45fc5635 2026-05-10 00:43:13,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3198197af08e45fc5635 HTTP/1.1" 200 None 2026-05-10 00:43:13,827 - lava_callback - DEBUG - Processing node 69fd3198197af08e45fc5635: baseline-arm-clabbe 2026-05-10 00:43:13,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3198197af08e45fc5635 2026-05-10 00:43:13,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3198197af08e45fc5635 HTTP/1.1" 200 None 2026-05-10 00:43:13,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:43:13,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:13,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3198197af08e45fc5635 HTTP/1.1" 200 None 2026-05-10 00:43:13,896 - lava_callback - ERROR - Error processing callback for node 69fd3198197af08e45fc5635: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:43:14,460 - lava_callback - INFO - Received callback for node 69fd3199197af08e45fc5638 INFO: 172.20.0.1:52350 - "POST /node/69fd3199197af08e45fc5638 HTTP/1.0" 202 Accepted 2026-05-10 00:43:14,466 - lava_callback - INFO - Starting async job submit for node 69fd3199197af08e45fc5638 2026-05-10 00:43:14,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:14,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3199197af08e45fc5638 HTTP/1.1" 200 None 2026-05-10 00:43:14,481 - lava_callback - DEBUG - Processing node 69fd3199197af08e45fc5638: baseline-arm-clabbe 2026-05-10 00:43:14,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3199197af08e45fc5638 2026-05-10 00:43:14,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:14,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3199197af08e45fc5638 HTTP/1.1" 200 None 2026-05-10 00:43:14,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:14,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:43:14,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:14,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3199197af08e45fc5638 HTTP/1.1" 200 None 2026-05-10 00:43:14,527 - lava_callback - ERROR - Error processing callback for node 69fd3199197af08e45fc5638: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:43:15,149 - lava_callback - INFO - Received callback for node 69fd319a197af08e45fc563b INFO: 172.20.0.1:52352 - "POST /node/69fd319a197af08e45fc563b HTTP/1.0" 202 Accepted 2026-05-10 00:43:15,155 - lava_callback - INFO - Starting async job submit for node 69fd319a197af08e45fc563b 2026-05-10 00:43:15,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:52366 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 00:43:15,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319a197af08e45fc563b HTTP/1.1" 200 None 2026-05-10 00:43:15,172 - lava_callback - DEBUG - Processing node 69fd319a197af08e45fc563b: baseline-arm-clabbe 2026-05-10 00:43:15,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd319a197af08e45fc563b 2026-05-10 00:43:15,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:15,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319a197af08e45fc563b HTTP/1.1" 200 None 2026-05-10 00:43:15,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:15,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:43:15,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:15,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd319a197af08e45fc563b HTTP/1.1" 200 None 2026-05-10 00:43:15,221 - lava_callback - ERROR - Error processing callback for node 69fd319a197af08e45fc563b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:43:15,852 - lava_callback - INFO - Received callback for node 69fd319b197af08e45fc5643 INFO: 172.20.0.1:52370 - "POST /node/69fd319b197af08e45fc5643 HTTP/1.0" 202 Accepted 2026-05-10 00:43:15,857 - lava_callback - INFO - Starting async job submit for node 69fd319b197af08e45fc5643 2026-05-10 00:43:15,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:15,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319b197af08e45fc5643 HTTP/1.1" 200 None 2026-05-10 00:43:15,872 - lava_callback - DEBUG - Processing node 69fd319b197af08e45fc5643: baseline-arm-clabbe 2026-05-10 00:43:15,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd319b197af08e45fc5643 2026-05-10 00:43:15,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:15,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd319b197af08e45fc5643 HTTP/1.1" 200 None 2026-05-10 00:43:15,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:15,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 00:43:15,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:15,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd319b197af08e45fc5643 HTTP/1.1" 200 None 2026-05-10 00:43:15,925 - lava_callback - ERROR - Error processing callback for node 69fd319b197af08e45fc5643: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40394 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:43:22,783 - lava_callback - INFO - Received callback for node 69ffd4458d5045ce94720bb7 INFO: 172.20.0.1:40402 - "POST /node/69ffd4458d5045ce94720bb7 HTTP/1.0" 202 Accepted 2026-05-10 00:43:22,789 - lava_callback - INFO - Starting async job submit for node 69ffd4458d5045ce94720bb7 2026-05-10 00:43:22,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:22,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4458d5045ce94720bb7 HTTP/1.1" 200 None 2026-05-10 00:43:22,827 - lava_callback - DEBUG - Processing node 69ffd4458d5045ce94720bb7: baseline-arm-kontron 2026-05-10 00:43:23,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:23,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:23,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ffd4458d5045ce94720bb7/log.txt.gz 2026-05-10 00:43:23,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:23,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:23,444 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ffd4458d5045ce94720bb7/lava-logs.yaml 2026-05-10 00:43:23,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:23,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:23,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ffd4458d5045ce94720bb7/lava_callback.json.gz 2026-05-10 00:43:23,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:23,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4458d5045ce94720bb7 HTTP/1.1" 200 None 2026-05-10 00:43:23,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:23,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:23,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:23,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4458d5045ce94720bb7 HTTP/1.1" 200 None 2026-05-10 00:43:23,611 - lava_callback - INFO - Completed processing callback for node 69ffd4458d5045ce94720bb7 2026-05-10 00:43:24,078 - lava_callback - INFO - Received callback for node 69ffd4478d5045ce94720bba INFO: 172.20.0.1:40416 - "POST /node/69ffd4478d5045ce94720bba HTTP/1.0" 202 Accepted 2026-05-10 00:43:24,084 - lava_callback - INFO - Starting async job submit for node 69ffd4478d5045ce94720bba 2026-05-10 00:43:24,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:24,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4478d5045ce94720bba HTTP/1.1" 200 None 2026-05-10 00:43:24,134 - lava_callback - DEBUG - Processing node 69ffd4478d5045ce94720bba: baseline-arm-kontron 2026-05-10 00:43:24,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:24,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:24,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ffd4478d5045ce94720bba/log.txt.gz 2026-05-10 00:43:24,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:24,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:24,680 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ffd4478d5045ce94720bba/lava-logs.yaml 2026-05-10 00:43:24,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:24,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:24,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69ffd4478d5045ce94720bba/lava_callback.json.gz 2026-05-10 00:43:24,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:24,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4478d5045ce94720bba HTTP/1.1" 200 None 2026-05-10 00:43:24,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:24,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:24,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4478d5045ce94720bba HTTP/1.1" 200 None 2026-05-10 00:43:24,867 - lava_callback - INFO - Completed processing callback for node 69ffd4478d5045ce94720bba INFO: 172.20.0.1:40426 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:43:30,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:30,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:56784 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:43:37,352 - lava_callback - INFO - Received callback for node 69ffd4a18d5045ce94720c92 INFO: 172.20.0.1:56794 - "POST /node/69ffd4a18d5045ce94720c92 HTTP/1.0" 202 Accepted 2026-05-10 00:43:37,400 - lava_callback - INFO - Starting async job submit for node 69ffd4a18d5045ce94720c92 2026-05-10 00:43:37,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:37,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4a18d5045ce94720c92 HTTP/1.1" 200 None 2026-05-10 00:43:37,456 - lava_callback - DEBUG - Processing node 69ffd4a18d5045ce94720c92: baseline-arm 2026-05-10 00:43:37,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:37,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:37,716 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4a18d5045ce94720c92/log.txt.gz 2026-05-10 00:43:37,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:37,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:37,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4a18d5045ce94720c92/lava-logs.yaml 2026-05-10 00:43:37,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:38,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:38,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4a18d5045ce94720c92/lava_callback.json.gz 2026-05-10 00:43:38,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:38,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4a18d5045ce94720c92 HTTP/1.1" 200 None 2026-05-10 00:43:38,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:38,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:38,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:38,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4a18d5045ce94720c92 HTTP/1.1" 200 None 2026-05-10 00:43:38,158 - lava_callback - INFO - Completed processing callback for node 69ffd4a18d5045ce94720c92 INFO: 172.20.0.1:51502 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:43:51,471 - lava_callback - INFO - Received callback for node 69fd31c1197af08e45fc56a1 INFO: 172.20.0.1:39848 - "POST /node/69fd31c1197af08e45fc56a1 HTTP/1.0" 202 Accepted 2026-05-10 00:43:51,477 - lava_callback - INFO - Starting async job submit for node 69fd31c1197af08e45fc56a1 2026-05-10 00:43:51,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:51,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c1197af08e45fc56a1 HTTP/1.1" 200 None 2026-05-10 00:43:51,496 - lava_callback - DEBUG - Processing node 69fd31c1197af08e45fc56a1: baseline-arm-clabbe 2026-05-10 00:43:51,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd31c1197af08e45fc56a1 2026-05-10 00:43:51,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:51,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd31c1197af08e45fc56a1 HTTP/1.1" 200 None 2026-05-10 00:43:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:51,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 00:43:51,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:51,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd31c1197af08e45fc56a1 HTTP/1.1" 200 None 2026-05-10 00:43:51,570 - lava_callback - ERROR - Error processing callback for node 69fd31c1197af08e45fc56a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:43:52,607 - lava_callback - INFO - Received callback for node 69ffd43d8d5045ce94720b6c INFO: 172.20.0.1:39860 - "POST /node/69ffd43d8d5045ce94720b6c HTTP/1.0" 202 Accepted 2026-05-10 00:43:52,616 - lava_callback - INFO - Starting async job submit for node 69ffd43d8d5045ce94720b6c 2026-05-10 00:43:52,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:52,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd43d8d5045ce94720b6c HTTP/1.1" 200 None 2026-05-10 00:43:52,671 - lava_callback - DEBUG - Processing node 69ffd43d8d5045ce94720b6c: baseline-arm-clabbe 2026-05-10 00:43:52,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:53,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:53,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd43d8d5045ce94720b6c/log.txt.gz 2026-05-10 00:43:53,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:53,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:53,328 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd43d8d5045ce94720b6c/lava-logs.yaml 2026-05-10 00:43:53,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:53,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:53,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd43d8d5045ce94720b6c/lava_callback.json.gz 2026-05-10 00:43:53,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:53,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd43d8d5045ce94720b6c HTTP/1.1" 200 None 2026-05-10 00:43:53,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:53,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:53,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:53,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd43d8d5045ce94720b6c HTTP/1.1" 200 None 2026-05-10 00:43:53,553 - lava_callback - INFO - Completed processing callback for node 69ffd43d8d5045ce94720b6c INFO: 172.20.0.1:39870 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:43:57,785 - lava_callback - INFO - Received callback for node 69ffd4638d5045ce94720c07 INFO: 172.20.0.1:39872 - "POST /node/69ffd4638d5045ce94720c07 HTTP/1.0" 202 Accepted 2026-05-10 00:43:57,793 - lava_callback - INFO - Starting async job submit for node 69ffd4638d5045ce94720c07 2026-05-10 00:43:57,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:57,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4638d5045ce94720c07 HTTP/1.1" 200 None 2026-05-10 00:43:57,849 - lava_callback - DEBUG - Processing node 69ffd4638d5045ce94720c07: ltp-dio 2026-05-10 00:43:58,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:58,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:58,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ffd4638d5045ce94720c07/log.txt.gz 2026-05-10 00:43:58,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:58,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:58,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ffd4638d5045ce94720c07/lava-logs.yaml 2026-05-10 00:43:58,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:43:58,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:43:58,984 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ffd4638d5045ce94720c07/lava_callback.json.gz 2026-05-10 00:43:59,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:59,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4638d5045ce94720c07 HTTP/1.1" 200 None 2026-05-10 00:43:59,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:59,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:43:59,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:43:59,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4638d5045ce94720c07 HTTP/1.1" 200 None 2026-05-10 00:43:59,073 - lava_callback - INFO - Completed processing callback for node 69ffd4638d5045ce94720c07 2026-05-10 00:44:00,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:00,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 00:44:02,373 - lava_callback - INFO - Received callback for node 69ffd4a28d5045ce94720c98 INFO: 172.20.0.1:60152 - "POST /node/69ffd4a28d5045ce94720c98 HTTP/1.0" 202 Accepted 2026-05-10 00:44:02,424 - lava_callback - INFO - Starting async job submit for node 69ffd4a28d5045ce94720c98 2026-05-10 00:44:02,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:02,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4a28d5045ce94720c98 HTTP/1.1" 200 None 2026-05-10 00:44:02,473 - lava_callback - DEBUG - Processing node 69ffd4a28d5045ce94720c98: baseline-arm 2026-05-10 00:44:02,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:02,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:02,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4a28d5045ce94720c98/log.txt.gz 2026-05-10 00:44:02,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:02,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:02,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4a28d5045ce94720c98/lava-logs.yaml 2026-05-10 00:44:02,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:03,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:03,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4a28d5045ce94720c98/lava_callback.json.gz 2026-05-10 00:44:03,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:03,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4a28d5045ce94720c98 HTTP/1.1" 200 None 2026-05-10 00:44:03,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:03,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:44:03,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:03,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4a28d5045ce94720c98 HTTP/1.1" 200 None 2026-05-10 00:44:03,125 - lava_callback - INFO - Completed processing callback for node 69ffd4a28d5045ce94720c98 INFO: 172.20.0.1:60154 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:44:09,583 - lava_callback - INFO - Received callback for node 69ffd43e8d5045ce94720b72 INFO: 172.20.0.1:60170 - "POST /node/69ffd43e8d5045ce94720b72 HTTP/1.0" 202 Accepted 2026-05-10 00:44:09,590 - lava_callback - INFO - Starting async job submit for node 69ffd43e8d5045ce94720b72 2026-05-10 00:44:09,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:09,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd43e8d5045ce94720b72 HTTP/1.1" 200 None 2026-05-10 00:44:09,636 - lava_callback - DEBUG - Processing node 69ffd43e8d5045ce94720b72: baseline-arm-clabbe 2026-05-10 00:44:09,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:09,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:09,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd43e8d5045ce94720b72/log.txt.gz 2026-05-10 00:44:10,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:10,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:10,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd43e8d5045ce94720b72/lava-logs.yaml 2026-05-10 00:44:10,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:10,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:10,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd43e8d5045ce94720b72/lava_callback.json.gz 2026-05-10 00:44:10,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:10,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd43e8d5045ce94720b72 HTTP/1.1" 200 None 2026-05-10 00:44:10,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:10,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:44:10,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:10,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd43e8d5045ce94720b72 HTTP/1.1" 200 None 2026-05-10 00:44:10,443 - lava_callback - INFO - Completed processing callback for node 69ffd43e8d5045ce94720b72 INFO: 172.20.0.1:46200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46204 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:44:19,558 - lava_callback - INFO - Received callback for node 69ffd4368d5045ce94720b4e INFO: 172.20.0.1:46212 - "POST /node/69ffd4368d5045ce94720b4e HTTP/1.0" 202 Accepted 2026-05-10 00:44:19,565 - lava_callback - INFO - Starting async job submit for node 69ffd4368d5045ce94720b4e 2026-05-10 00:44:19,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4368d5045ce94720b4e HTTP/1.1" 200 None 2026-05-10 00:44:19,615 - lava_callback - DEBUG - Processing node 69ffd4368d5045ce94720b4e: baseline-arm-broonie 2026-05-10 00:44:19,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:19,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:19,977 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4368d5045ce94720b4e/log.txt.gz 2026-05-10 00:44:20,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:20,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:20,286 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4368d5045ce94720b4e/lava-logs.yaml 2026-05-10 00:44:20,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:44:20,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:44:20,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ffd4368d5045ce94720b4e/lava_callback.json.gz 2026-05-10 00:44:20,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:20,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4368d5045ce94720b4e HTTP/1.1" 200 None 2026-05-10 00:44:20,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:20,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:44:20,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:20,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4368d5045ce94720b4e HTTP/1.1" 200 None 2026-05-10 00:44:20,485 - lava_callback - INFO - Completed processing callback for node 69ffd4368d5045ce94720b4e INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58554 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:44:30,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:44:30,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46430 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:45:03,282 - lava_callback - INFO - Received callback for node 69ffd4ee8d5045ce94720cf4 INFO: 172.20.0.1:40152 - "POST /node/69ffd4ee8d5045ce94720cf4 HTTP/1.0" 202 Accepted 2026-05-10 00:45:03,288 - lava_callback - INFO - Starting async job submit for node 69ffd4ee8d5045ce94720cf4 2026-05-10 00:45:03,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:03,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4ee8d5045ce94720cf4 HTTP/1.1" 200 None 2026-05-10 00:45:03,307 - lava_callback - DEBUG - Processing node 69ffd4ee8d5045ce94720cf4: baseline-arm 2026-05-10 00:45:03,312 - lava_callback - WARNING - Failed to upload log 2026-05-10 00:45:03,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:03,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:03,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4ee8d5045ce94720cf4/lava-logs.yaml 2026-05-10 00:45:03,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:03,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:03,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4ee8d5045ce94720cf4/lava_callback.json.gz 2026-05-10 00:45:03,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:03,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4ee8d5045ce94720cf4 HTTP/1.1" 200 None 2026-05-10 00:45:03,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:03,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:45:03,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:03,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4ee8d5045ce94720cf4 HTTP/1.1" 200 None 2026-05-10 00:45:03,593 - lava_callback - INFO - Completed processing callback for node 69ffd4ee8d5045ce94720cf4 INFO: 172.20.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39256 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:45:30,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:30,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:45:48,668 - lava_callback - INFO - Received callback for node 69ffd4438d5045ce94720bb1 INFO: 172.20.0.1:46794 - "POST /node/69ffd4438d5045ce94720bb1 HTTP/1.0" 202 Accepted 2026-05-10 00:45:48,674 - lava_callback - INFO - Starting async job submit for node 69ffd4438d5045ce94720bb1 2026-05-10 00:45:48,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:48,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4438d5045ce94720bb1 HTTP/1.1" 200 None 2026-05-10 00:45:48,710 - lava_callback - DEBUG - Processing node 69ffd4438d5045ce94720bb1: baseline-arm-clabbe 2026-05-10 00:45:48,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:48,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:49,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd4438d5045ce94720bb1/log.txt.gz 2026-05-10 00:45:49,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:49,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:49,302 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd4438d5045ce94720bb1/lava-logs.yaml 2026-05-10 00:45:49,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:49,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:49,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ffd4438d5045ce94720bb1/lava_callback.json.gz 2026-05-10 00:45:49,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:49,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4438d5045ce94720bb1 HTTP/1.1" 200 None 2026-05-10 00:45:49,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:49,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:45:49,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:49,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4438d5045ce94720bb1 HTTP/1.1" 200 None 2026-05-10 00:45:49,489 - lava_callback - INFO - Completed processing callback for node 69ffd4438d5045ce94720bb1 INFO: 172.20.0.1:43128 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:45:57,506 - lava_callback - INFO - Received callback for node 69ffd4608d5045ce94720c01 INFO: 172.20.0.1:43130 - "POST /node/69ffd4608d5045ce94720c01 HTTP/1.0" 202 Accepted 2026-05-10 00:45:57,512 - lava_callback - INFO - Starting async job submit for node 69ffd4608d5045ce94720c01 2026-05-10 00:45:57,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:57,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4608d5045ce94720c01 HTTP/1.1" 200 None 2026-05-10 00:45:57,552 - lava_callback - DEBUG - Processing node 69ffd4608d5045ce94720c01: ltp-controllers 2026-05-10 00:45:58,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:58,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:58,166 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ffd4608d5045ce94720c01/log.txt.gz 2026-05-10 00:45:58,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:58,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:58,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ffd4608d5045ce94720c01/lava-logs.yaml 2026-05-10 00:45:58,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:45:58,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:45:58,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ffd4608d5045ce94720c01/lava_callback.json.gz 2026-05-10 00:45:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:58,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4608d5045ce94720c01 HTTP/1.1" 200 None 2026-05-10 00:45:58,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:58,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:45:58,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:58,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4608d5045ce94720c01 HTTP/1.1" 200 None 2026-05-10 00:45:58,769 - lava_callback - INFO - Completed processing callback for node 69ffd4608d5045ce94720c01 2026-05-10 00:45:59,797 - lava_callback - INFO - Received callback for node 69ffd45d8d5045ce94720bdf INFO: 172.20.0.1:39632 - "POST /node/69ffd45d8d5045ce94720bdf HTTP/1.0" 202 Accepted 2026-05-10 00:45:59,804 - lava_callback - INFO - Starting async job submit for node 69ffd45d8d5045ce94720bdf 2026-05-10 00:45:59,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:45:59,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd45d8d5045ce94720bdf HTTP/1.1" 200 None 2026-05-10 00:45:59,844 - lava_callback - DEBUG - Processing node 69ffd45d8d5045ce94720bdf: ltp-cap_bounds 2026-05-10 00:46:00,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:00,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:00,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ffd45d8d5045ce94720bdf/log.txt.gz 2026-05-10 00:46:00,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:00,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:00,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ffd45d8d5045ce94720bdf/lava-logs.yaml 2026-05-10 00:46:00,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:00,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:00,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ffd45d8d5045ce94720bdf/lava_callback.json.gz 2026-05-10 00:46:00,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:00,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:00,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd45d8d5045ce94720bdf HTTP/1.1" 200 None 2026-05-10 00:46:00,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:00,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 00:46:00,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:46:00,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:00,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd45d8d5045ce94720bdf HTTP/1.1" 200 None 2026-05-10 00:46:00,900 - lava_callback - INFO - Completed processing callback for node 69ffd45d8d5045ce94720bdf 2026-05-10 00:46:01,424 - lava_callback - INFO - Received callback for node 69ffd45e8d5045ce94720be2 INFO: 172.20.0.1:39640 - "POST /node/69ffd45e8d5045ce94720be2 HTTP/1.0" 202 Accepted 2026-05-10 00:46:01,431 - lava_callback - INFO - Starting async job submit for node 69ffd45e8d5045ce94720be2 2026-05-10 00:46:01,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:01,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd45e8d5045ce94720be2 HTTP/1.1" 200 None 2026-05-10 00:46:01,477 - lava_callback - DEBUG - Processing node 69ffd45e8d5045ce94720be2: ltp-containers 2026-05-10 00:46:01,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:01,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:01,940 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ffd45e8d5045ce94720be2/log.txt.gz 2026-05-10 00:46:02,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:02,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:02,301 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ffd45e8d5045ce94720be2/lava-logs.yaml 2026-05-10 00:46:02,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:02,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:02,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ffd45e8d5045ce94720be2/lava_callback.json.gz 2026-05-10 00:46:02,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:02,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd45e8d5045ce94720be2 HTTP/1.1" 200 None 2026-05-10 00:46:02,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:02,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:46:02,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:02,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd45e8d5045ce94720be2 HTTP/1.1" 200 None 2026-05-10 00:46:02,502 - lava_callback - INFO - Completed processing callback for node 69ffd45e8d5045ce94720be2 INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44214 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:46:20,285 - lava_callback - INFO - Received callback for node 69ffd46f8d5045ce94720c1f INFO: 172.20.0.1:51522 - "POST /node/69ffd46f8d5045ce94720c1f HTTP/1.0" 202 Accepted 2026-05-10 00:46:20,293 - lava_callback - INFO - Starting async job submit for node 69ffd46f8d5045ce94720c1f 2026-05-10 00:46:20,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:20,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46f8d5045ce94720c1f HTTP/1.1" 200 None 2026-05-10 00:46:20,333 - lava_callback - DEBUG - Processing node 69ffd46f8d5045ce94720c1f: ltp-syscalls INFO: 172.20.0.1:51530 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:46:21,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:21,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:21,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ffd46f8d5045ce94720c1f/log.txt.gz 2026-05-10 00:46:21,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:21,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:21,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ffd46f8d5045ce94720c1f/lava-logs.yaml 2026-05-10 00:46:21,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:22,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:22,046 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ffd46f8d5045ce94720c1f/lava_callback.json.gz 2026-05-10 00:46:22,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:22,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46f8d5045ce94720c1f HTTP/1.1" 200 None 2026-05-10 00:46:22,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:22,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:46:22,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:22,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd46f8d5045ce94720c1f HTTP/1.1" 200 None 2026-05-10 00:46:22,129 - lava_callback - INFO - Completed processing callback for node 69ffd46f8d5045ce94720c1f INFO: 172.20.0.1:51538 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:46:30,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:30,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33928 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:46:39,855 - lava_callback - INFO - Received callback for node 69ffd4628d5045ce94720c04 INFO: 172.20.0.1:33026 - "POST /node/69ffd4628d5045ce94720c04 HTTP/1.0" 202 Accepted 2026-05-10 00:46:39,862 - lava_callback - INFO - Starting async job submit for node 69ffd4628d5045ce94720c04 2026-05-10 00:46:39,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:39,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4628d5045ce94720c04 HTTP/1.1" 200 None 2026-05-10 00:46:39,935 - lava_callback - DEBUG - Processing node 69ffd4628d5045ce94720c04: ltp-cve 2026-05-10 00:46:40,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:40,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:40,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ffd4628d5045ce94720c04/log.txt.gz 2026-05-10 00:46:40,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:41,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:41,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ffd4628d5045ce94720c04/lava-logs.yaml 2026-05-10 00:46:41,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:46:41,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:46:41,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ffd4628d5045ce94720c04/lava_callback.json.gz 2026-05-10 00:46:41,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:41,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4628d5045ce94720c04 HTTP/1.1" 200 None 2026-05-10 00:46:41,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:41,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:46:41,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:46:41,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4628d5045ce94720c04 HTTP/1.1" 200 None 2026-05-10 00:46:41,340 - lava_callback - INFO - Completed processing callback for node 69ffd4628d5045ce94720c04 INFO: 172.20.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59886 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:47:00,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:47:00,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49764 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:47:31,726 - lava_callback - INFO - Received callback for node 69fd329e197af08e45fc5789 INFO: 172.20.0.1:50110 - "POST /node/69fd329e197af08e45fc5789 HTTP/1.0" 202 Accepted 2026-05-10 00:47:31,735 - lava_callback - INFO - Starting async job submit for node 69fd329e197af08e45fc5789 2026-05-10 00:47:31,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:47:31,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd329e197af08e45fc5789 HTTP/1.1" 200 None 2026-05-10 00:47:31,770 - lava_callback - DEBUG - Processing node 69fd329e197af08e45fc5789: baseline-arm-clabbe 2026-05-10 00:47:31,771 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd329e197af08e45fc5789 2026-05-10 00:47:31,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:47:31,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd329e197af08e45fc5789 HTTP/1.1" 200 None 2026-05-10 00:47:31,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:47:31,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 00:47:31,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:47:31,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd329e197af08e45fc5789 HTTP/1.1" 200 None 2026-05-10 00:47:31,903 - lava_callback - ERROR - Error processing callback for node 69fd329e197af08e45fc5789: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54046 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:48:11,722 - lava_callback - INFO - Received callback for node 69fd32c5197af08e45fc57a5 INFO: 172.20.0.1:56622 - "POST /node/69fd32c5197af08e45fc57a5 HTTP/1.0" 202 Accepted 2026-05-10 00:48:11,728 - lava_callback - INFO - Starting async job submit for node 69fd32c5197af08e45fc57a5 2026-05-10 00:48:11,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:11,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd32c5197af08e45fc57a5 HTTP/1.1" 200 None 2026-05-10 00:48:11,744 - lava_callback - DEBUG - Processing node 69fd32c5197af08e45fc57a5: baseline-arm-clabbe 2026-05-10 00:48:11,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd32c5197af08e45fc57a5 2026-05-10 00:48:11,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:11,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd32c5197af08e45fc57a5 HTTP/1.1" 200 None 2026-05-10 00:48:11,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:11,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 00:48:11,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:11,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd32c5197af08e45fc57a5 HTTP/1.1" 200 None 2026-05-10 00:48:11,794 - lava_callback - ERROR - Error processing callback for node 69fd32c5197af08e45fc57a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55416 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:48:40,326 - lava_callback - INFO - Received callback for node 69ffd5bf8d5045ce94720d75 INFO: 172.20.0.1:55910 - "POST /node/69ffd5bf8d5045ce94720d75 HTTP/1.0" 202 Accepted 2026-05-10 00:48:40,333 - lava_callback - INFO - Starting async job submit for node 69ffd5bf8d5045ce94720d75 2026-05-10 00:48:40,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:40,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5bf8d5045ce94720d75 HTTP/1.1" 200 None 2026-05-10 00:48:40,367 - lava_callback - DEBUG - Processing node 69ffd5bf8d5045ce94720d75: baseline-arm64 2026-05-10 00:48:40,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:40,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:40,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5bf8d5045ce94720d75/log.txt.gz 2026-05-10 00:48:40,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:40,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:40,917 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5bf8d5045ce94720d75/lava-logs.yaml 2026-05-10 00:48:40,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:41,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:41,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5bf8d5045ce94720d75/lava_callback.json.gz 2026-05-10 00:48:41,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:41,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5bf8d5045ce94720d75 HTTP/1.1" 200 None 2026-05-10 00:48:41,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:41,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:48:41,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:41,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5bf8d5045ce94720d75 HTTP/1.1" 200 None 2026-05-10 00:48:41,087 - lava_callback - INFO - Completed processing callback for node 69ffd5bf8d5045ce94720d75 INFO: 172.20.0.1:55922 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:48:47,573 - lava_callback - INFO - Received callback for node 69ffd5cb8d5045ce94720daa INFO: 172.20.0.1:55932 - "POST /node/69ffd5cb8d5045ce94720daa HTTP/1.0" 202 Accepted 2026-05-10 00:48:47,580 - lava_callback - INFO - Starting async job submit for node 69ffd5cb8d5045ce94720daa 2026-05-10 00:48:47,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:47,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5cb8d5045ce94720daa HTTP/1.1" 200 None 2026-05-10 00:48:47,613 - lava_callback - DEBUG - Processing node 69ffd5cb8d5045ce94720daa: baseline-arm64 2026-05-10 00:48:47,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:47,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:47,899 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cb8d5045ce94720daa/log.txt.gz 2026-05-10 00:48:47,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:48,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:48,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cb8d5045ce94720daa/lava-logs.yaml 2026-05-10 00:48:48,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:48,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:48,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cb8d5045ce94720daa/lava_callback.json.gz 2026-05-10 00:48:48,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:48,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5cb8d5045ce94720daa HTTP/1.1" 200 None 2026-05-10 00:48:48,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:48,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:48:48,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:48,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5cb8d5045ce94720daa HTTP/1.1" 200 None 2026-05-10 00:48:48,320 - lava_callback - INFO - Completed processing callback for node 69ffd5cb8d5045ce94720daa 2026-05-10 00:48:51,791 - lava_callback - INFO - Received callback for node 69fd32eb197af08e45fc57bf INFO: 172.20.0.1:38736 - "POST /node/69fd32eb197af08e45fc57bf HTTP/1.0" 202 Accepted 2026-05-10 00:48:51,801 - lava_callback - INFO - Starting async job submit for node 69fd32eb197af08e45fc57bf 2026-05-10 00:48:51,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:51,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd32eb197af08e45fc57bf HTTP/1.1" 200 None 2026-05-10 00:48:51,831 - lava_callback - DEBUG - Processing node 69fd32eb197af08e45fc57bf: baseline-arm-clabbe 2026-05-10 00:48:51,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd32eb197af08e45fc57bf 2026-05-10 00:48:51,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:51,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd32eb197af08e45fc57bf HTTP/1.1" 200 None 2026-05-10 00:48:51,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:51,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 00:48:51,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:51,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd32eb197af08e45fc57bf HTTP/1.1" 200 None 2026-05-10 00:48:51,910 - lava_callback - ERROR - Error processing callback for node 69fd32eb197af08e45fc57bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38746 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:48:57,982 - lava_callback - INFO - Received callback for node 69ffd5d98d5045ce94720dd3 INFO: 172.20.0.1:38760 - "POST /node/69ffd5d98d5045ce94720dd3 HTTP/1.0" 202 Accepted 2026-05-10 00:48:57,988 - lava_callback - INFO - Starting async job submit for node 69ffd5d98d5045ce94720dd3 2026-05-10 00:48:57,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:58,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d98d5045ce94720dd3 HTTP/1.1" 200 None 2026-05-10 00:48:58,013 - lava_callback - DEBUG - Processing node 69ffd5d98d5045ce94720dd3: baseline-nfs-arm64 2026-05-10 00:48:58,016 - lava_callback - WARNING - Failed to upload log 2026-05-10 00:48:58,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:58,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:58,128 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d98d5045ce94720dd3/lava-logs.yaml 2026-05-10 00:48:58,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:48:58,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:48:58,224 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d98d5045ce94720dd3/lava_callback.json.gz 2026-05-10 00:48:58,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:58,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d98d5045ce94720dd3 HTTP/1.1" 200 None 2026-05-10 00:48:58,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:58,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:48:58,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:48:58,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d98d5045ce94720dd3 HTTP/1.1" 200 None 2026-05-10 00:48:58,278 - lava_callback - INFO - Completed processing callback for node 69ffd5d98d5045ce94720dd3 2026-05-10 00:49:00,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:00,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:40190 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:49:08,357 - lava_callback - INFO - Received callback for node 69ffd5c08d5045ce94720d7b INFO: 172.20.0.1:40206 - "POST /node/69ffd5c08d5045ce94720d7b HTTP/1.0" 202 Accepted 2026-05-10 00:49:08,363 - lava_callback - INFO - Starting async job submit for node 69ffd5c08d5045ce94720d7b 2026-05-10 00:49:08,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:08,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c08d5045ce94720d7b HTTP/1.1" 200 None 2026-05-10 00:49:08,400 - lava_callback - DEBUG - Processing node 69ffd5c08d5045ce94720d7b: baseline-arm64 2026-05-10 00:49:08,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:08,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:08,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c08d5045ce94720d7b/log.txt.gz 2026-05-10 00:49:08,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:09,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:09,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c08d5045ce94720d7b/lava-logs.yaml 2026-05-10 00:49:09,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:09,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:09,309 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c08d5045ce94720d7b/lava_callback.json.gz 2026-05-10 00:49:09,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:09,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c08d5045ce94720d7b HTTP/1.1" 200 None 2026-05-10 00:49:09,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:09,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:49:09,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:09,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c08d5045ce94720d7b HTTP/1.1" 200 None 2026-05-10 00:49:09,434 - lava_callback - INFO - Completed processing callback for node 69ffd5c08d5045ce94720d7b INFO: 172.20.0.1:44016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41682 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:49:30,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:30,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 00:49:31,731 - lava_callback - INFO - Received callback for node 69fd3310197af08e45fc57cc INFO: 172.20.0.1:45030 - "POST /node/69fd3310197af08e45fc57cc HTTP/1.0" 202 Accepted 2026-05-10 00:49:31,740 - lava_callback - INFO - Starting async job submit for node 69fd3310197af08e45fc57cc 2026-05-10 00:49:31,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:31,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3310197af08e45fc57cc HTTP/1.1" 200 None 2026-05-10 00:49:31,765 - lava_callback - DEBUG - Processing node 69fd3310197af08e45fc57cc: baseline-arm-clabbe 2026-05-10 00:49:31,765 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3310197af08e45fc57cc 2026-05-10 00:49:31,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:31,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3310197af08e45fc57cc HTTP/1.1" 200 None 2026-05-10 00:49:31,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:31,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 00:49:31,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:31,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3310197af08e45fc57cc HTTP/1.1" 200 None 2026-05-10 00:49:31,840 - lava_callback - ERROR - Error processing callback for node 69fd3310197af08e45fc57cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45034 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:49:44,078 - lava_callback - INFO - Received callback for node 69ffd5c08d5045ce94720d78 INFO: 172.20.0.1:58280 - "POST /node/69ffd5c08d5045ce94720d78 HTTP/1.0" 202 Accepted 2026-05-10 00:49:44,085 - lava_callback - INFO - Starting async job submit for node 69ffd5c08d5045ce94720d78 2026-05-10 00:49:44,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:44,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c08d5045ce94720d78 HTTP/1.1" 200 None 2026-05-10 00:49:44,125 - lava_callback - DEBUG - Processing node 69ffd5c08d5045ce94720d78: baseline-arm64 2026-05-10 00:49:44,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:44,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:44,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c08d5045ce94720d78/log.txt.gz 2026-05-10 00:49:44,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:44,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:44,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c08d5045ce94720d78/lava-logs.yaml 2026-05-10 00:49:44,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:44,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:44,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c08d5045ce94720d78/lava_callback.json.gz 2026-05-10 00:49:45,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:45,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c08d5045ce94720d78 HTTP/1.1" 200 None 2026-05-10 00:49:45,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:45,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:49:45,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:45,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c08d5045ce94720d78 HTTP/1.1" 200 None 2026-05-10 00:49:45,113 - lava_callback - INFO - Completed processing callback for node 69ffd5c08d5045ce94720d78 INFO: 172.20.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54154 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:49:57,638 - lava_callback - INFO - Received callback for node 69ffd4698d5045ce94720c13 INFO: 172.20.0.1:54162 - "POST /node/69ffd4698d5045ce94720c13 HTTP/1.0" 202 Accepted 2026-05-10 00:49:57,648 - lava_callback - INFO - Starting async job submit for node 69ffd4698d5045ce94720c13 2026-05-10 00:49:57,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:57,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4698d5045ce94720c13 HTTP/1.1" 200 None 2026-05-10 00:49:57,689 - lava_callback - DEBUG - Processing node 69ffd4698d5045ce94720c13: ltp-ipc 2026-05-10 00:49:58,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:58,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:58,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ffd4698d5045ce94720c13/log.txt.gz 2026-05-10 00:49:58,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:58,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:58,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ffd4698d5045ce94720c13/lava-logs.yaml 2026-05-10 00:49:58,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:58,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:58,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ffd4698d5045ce94720c13/lava_callback.json.gz 2026-05-10 00:49:58,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:58,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4698d5045ce94720c13 HTTP/1.1" 200 None 2026-05-10 00:49:58,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:58,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:49:58,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:58,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4698d5045ce94720c13 HTTP/1.1" 200 None 2026-05-10 00:49:58,715 - lava_callback - INFO - Completed processing callback for node 69ffd4698d5045ce94720c13 2026-05-10 00:49:59,120 - lava_callback - INFO - Received callback for node 69ffd5e78d5045ce94720e17 INFO: 172.20.0.1:54166 - "POST /node/69ffd5e78d5045ce94720e17 HTTP/1.0" 202 Accepted 2026-05-10 00:49:59,128 - lava_callback - INFO - Starting async job submit for node 69ffd5e78d5045ce94720e17 2026-05-10 00:49:59,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:59,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5e78d5045ce94720e17 HTTP/1.1" 200 None 2026-05-10 00:49:59,175 - lava_callback - DEBUG - Processing node 69ffd5e78d5045ce94720e17: baseline-arm64-broonie 2026-05-10 00:49:59,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:59,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:59,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5e78d5045ce94720e17/log.txt.gz 2026-05-10 00:49:59,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:59,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:59,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5e78d5045ce94720e17/lava-logs.yaml 2026-05-10 00:49:59,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:49:59,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:49:59,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5e78d5045ce94720e17/lava_callback.json.gz 2026-05-10 00:49:59,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:49:59,965 - lava_callback - INFO - Received callback for node 69ffd4668d5045ce94720c0d INFO: 172.20.0.1:41062 - "POST /node/69ffd4668d5045ce94720c0d HTTP/1.0" 202 Accepted 2026-05-10 00:49:59,975 - lava_callback - INFO - Starting async job submit for node 69ffd4668d5045ce94720c0d 2026-05-10 00:50:00,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:00,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5e78d5045ce94720e17 HTTP/1.1" 200 None 2026-05-10 00:50:00,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:00,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4668d5045ce94720c0d HTTP/1.1" 200 None 2026-05-10 00:50:00,033 - lava_callback - DEBUG - Processing node 69ffd4668d5045ce94720c0d: ltp-fsx 2026-05-10 00:50:00,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:00,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:00,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5e78d5045ce94720e17 HTTP/1.1" 200 None 2026-05-10 00:50:00,234 - lava_callback - INFO - Completed processing callback for node 69ffd5e78d5045ce94720e17 2026-05-10 00:50:00,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:00,612 - lava_callback - INFO - Received callback for node 69ffd5ee8d5045ce94720e2a INFO: 172.20.0.1:41074 - "POST /node/69ffd5ee8d5045ce94720e2a HTTP/1.0" 202 Accepted 2026-05-10 00:50:00,619 - lava_callback - INFO - Starting async job submit for node 69ffd5ee8d5045ce94720e2a 2026-05-10 00:50:00,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:00,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:00,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ffd4668d5045ce94720c0d/log.txt.gz 2026-05-10 00:50:00,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ee8d5045ce94720e2a HTTP/1.1" 200 None 2026-05-10 00:50:00,695 - lava_callback - DEBUG - Processing node 69ffd5ee8d5045ce94720e2a: baseline-arm64-broonie 2026-05-10 00:50:01,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:01,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:01,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 00:50:01,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:01,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:01,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ee8d5045ce94720e2a/log.txt.gz 2026-05-10 00:50:01,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:01,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:01,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:01,541 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ee8d5045ce94720e2a/lava-logs.yaml 2026-05-10 00:50:01,541 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ffd4668d5045ce94720c0d/lava-logs.yaml 2026-05-10 00:50:01,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:01,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:01,555 - lava_callback - INFO - Received callback for node 69ffd4678d5045ce94720c10 2026-05-10 00:50:01,565 - lava_callback - INFO - Starting async job submit for node 69ffd4678d5045ce94720c10 INFO: 172.20.0.1:41084 - "POST /node/69ffd4678d5045ce94720c10 HTTP/1.0" 202 Accepted 2026-05-10 00:50:01,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:01,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4678d5045ce94720c10 HTTP/1.1" 200 None 2026-05-10 00:50:01,620 - lava_callback - DEBUG - Processing node 69ffd4678d5045ce94720c10: ltp-input 2026-05-10 00:50:01,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:01,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:01,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ee8d5045ce94720e2a/lava_callback.json.gz 2026-05-10 00:50:01,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ffd4668d5045ce94720c0d/lava_callback.json.gz 2026-05-10 00:50:01,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:01,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:01,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4668d5045ce94720c0d HTTP/1.1" 200 None 2026-05-10 00:50:01,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ee8d5045ce94720e2a HTTP/1.1" 200 None 2026-05-10 00:50:01,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:01,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:02,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:02,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:50:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:02,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:02,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:02,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5ee8d5045ce94720e2a HTTP/1.1" 200 None 2026-05-10 00:50:02,113 - lava_callback - INFO - Completed processing callback for node 69ffd5ee8d5045ce94720e2a 2026-05-10 00:50:02,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4668d5045ce94720c0d HTTP/1.1" 200 None 2026-05-10 00:50:02,141 - lava_callback - INFO - Completed processing callback for node 69ffd4668d5045ce94720c0d 2026-05-10 00:50:02,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:02,276 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ffd4678d5045ce94720c10/log.txt.gz 2026-05-10 00:50:02,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:02,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:02,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ffd4678d5045ce94720c10/lava-logs.yaml 2026-05-10 00:50:02,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:02,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:02,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ffd4678d5045ce94720c10/lava_callback.json.gz 2026-05-10 00:50:02,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:02,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4678d5045ce94720c10 HTTP/1.1" 200 None 2026-05-10 00:50:02,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:02,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:50:02,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:02,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4678d5045ce94720c10 HTTP/1.1" 200 None 2026-05-10 00:50:02,923 - lava_callback - INFO - Completed processing callback for node 69ffd4678d5045ce94720c10 2026-05-10 00:50:03,458 - lava_callback - INFO - Received callback for node 69ffd6008d5045ce94720e69 INFO: 172.20.0.1:41090 - "POST /node/69ffd6008d5045ce94720e69 HTTP/1.0" 202 Accepted 2026-05-10 00:50:03,464 - lava_callback - INFO - Starting async job submit for node 69ffd6008d5045ce94720e69 2026-05-10 00:50:03,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:03,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd6008d5045ce94720e69 HTTP/1.1" 200 None 2026-05-10 00:50:03,503 - lava_callback - DEBUG - Processing node 69ffd6008d5045ce94720e69: baseline-arm64-foundriesio 2026-05-10 00:50:03,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:03,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:03,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffd6008d5045ce94720e69/log.txt.gz 2026-05-10 00:50:03,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:04,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:04,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffd6008d5045ce94720e69/lava-logs.yaml 2026-05-10 00:50:04,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:04,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:04,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffd6008d5045ce94720e69/lava_callback.json.gz 2026-05-10 00:50:04,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:04,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd6008d5045ce94720e69 HTTP/1.1" 200 None 2026-05-10 00:50:04,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:04,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:04,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:04,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd6008d5045ce94720e69 HTTP/1.1" 200 None 2026-05-10 00:50:04,270 - lava_callback - INFO - Completed processing callback for node 69ffd6008d5045ce94720e69 2026-05-10 00:50:06,227 - lava_callback - INFO - Received callback for node 69ffd5fc8d5045ce94720e59 INFO: 172.20.0.1:41104 - "POST /node/69ffd5fc8d5045ce94720e59 HTTP/1.0" 202 Accepted 2026-05-10 00:50:06,233 - lava_callback - INFO - Starting async job submit for node 69ffd5fc8d5045ce94720e59 2026-05-10 00:50:06,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:06,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5fc8d5045ce94720e59 HTTP/1.1" 200 None 2026-05-10 00:50:06,268 - lava_callback - DEBUG - Processing node 69ffd5fc8d5045ce94720e59: baseline-arm64-pengutronix 2026-05-10 00:50:06,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:50:06,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:06,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5fc8d5045ce94720e59/log.txt.gz 2026-05-10 00:50:06,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:06,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:06,746 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5fc8d5045ce94720e59/lava-logs.yaml 2026-05-10 00:50:06,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:06,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:06,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5fc8d5045ce94720e59/lava_callback.json.gz 2026-05-10 00:50:06,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:06,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5fc8d5045ce94720e59 HTTP/1.1" 200 None 2026-05-10 00:50:06,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:06,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:06,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5fc8d5045ce94720e59 HTTP/1.1" 200 None 2026-05-10 00:50:06,926 - lava_callback - INFO - Completed processing callback for node 69ffd5fc8d5045ce94720e59 2026-05-10 00:50:11,961 - lava_callback - INFO - Received callback for node 69fd3337197af08e45fc57e9 INFO: 172.20.0.1:37436 - "POST /node/69fd3337197af08e45fc57e9 HTTP/1.0" 202 Accepted 2026-05-10 00:50:11,967 - lava_callback - INFO - Starting async job submit for node 69fd3337197af08e45fc57e9 2026-05-10 00:50:11,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:11,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3337197af08e45fc57e9 HTTP/1.1" 200 None 2026-05-10 00:50:11,983 - lava_callback - DEBUG - Processing node 69fd3337197af08e45fc57e9: baseline-arm-clabbe 2026-05-10 00:50:11,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3337197af08e45fc57e9 2026-05-10 00:50:11,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:11,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3337197af08e45fc57e9 HTTP/1.1" 200 None 2026-05-10 00:50:11,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:12,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 00:50:12,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:12,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3337197af08e45fc57e9 HTTP/1.1" 200 None 2026-05-10 00:50:12,046 - lava_callback - ERROR - Error processing callback for node 69fd3337197af08e45fc57e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:50:14,856 - lava_callback - INFO - Received callback for node 69ffd5fe8d5045ce94720e63 INFO: 172.20.0.1:37438 - "POST /node/69ffd5fe8d5045ce94720e63 HTTP/1.0" 202 Accepted 2026-05-10 00:50:14,866 - lava_callback - INFO - Starting async job submit for node 69ffd5fe8d5045ce94720e63 2026-05-10 00:50:14,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:14,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5fe8d5045ce94720e63 HTTP/1.1" 200 None 2026-05-10 00:50:14,904 - lava_callback - DEBUG - Processing node 69ffd5fe8d5045ce94720e63: baseline-arm64-pengutronix INFO: 172.20.0.1:37454 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 00:50:15,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:15,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:15,283 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5fe8d5045ce94720e63/log.txt.gz 2026-05-10 00:50:15,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:15,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:15,586 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5fe8d5045ce94720e63/lava-logs.yaml 2026-05-10 00:50:15,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:15,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:15,696 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5fe8d5045ce94720e63/lava_callback.json.gz 2026-05-10 00:50:15,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:15,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5fe8d5045ce94720e63 HTTP/1.1" 200 None 2026-05-10 00:50:15,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:15,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:15,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:15,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5fe8d5045ce94720e63 HTTP/1.1" 200 None 2026-05-10 00:50:15,772 - lava_callback - INFO - Completed processing callback for node 69ffd5fe8d5045ce94720e63 INFO: 172.20.0.1:37456 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:50:20,465 - lava_callback - INFO - Received callback for node 69ffd5eb8d5045ce94720e24 INFO: 172.20.0.1:49842 - "POST /node/69ffd5eb8d5045ce94720e24 HTTP/1.0" 202 Accepted 2026-05-10 00:50:20,472 - lava_callback - INFO - Starting async job submit for node 69ffd5eb8d5045ce94720e24 2026-05-10 00:50:20,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:20,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5eb8d5045ce94720e24 HTTP/1.1" 200 None 2026-05-10 00:50:20,510 - lava_callback - DEBUG - Processing node 69ffd5eb8d5045ce94720e24: baseline-arm64-broonie 2026-05-10 00:50:20,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:20,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:20,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5eb8d5045ce94720e24/log.txt.gz 2026-05-10 00:50:21,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49858 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:50:21,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:21,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5eb8d5045ce94720e24/lava-logs.yaml 2026-05-10 00:50:21,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:21,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:21,262 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5eb8d5045ce94720e24/lava_callback.json.gz 2026-05-10 00:50:21,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:21,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5eb8d5045ce94720e24 HTTP/1.1" 200 None 2026-05-10 00:50:21,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:21,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:21,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:21,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5eb8d5045ce94720e24 HTTP/1.1" 200 None 2026-05-10 00:50:21,339 - lava_callback - INFO - Completed processing callback for node 69ffd5eb8d5045ce94720e24 2026-05-10 00:50:21,419 - lava_callback - INFO - Received callback for node 69ffd5c78d5045ce94720d8e INFO: 172.20.0.1:49868 - "POST /node/69ffd5c78d5045ce94720d8e HTTP/1.0" 202 Accepted 2026-05-10 00:50:21,430 - lava_callback - INFO - Starting async job submit for node 69ffd5c78d5045ce94720d8e 2026-05-10 00:50:21,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:21,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c78d5045ce94720d8e HTTP/1.1" 200 None 2026-05-10 00:50:21,482 - lava_callback - DEBUG - Processing node 69ffd5c78d5045ce94720d8e: baseline-arm64 2026-05-10 00:50:21,941 - lava_callback - INFO - Received callback for node 69ffd5f18d5045ce94720e34 INFO: 172.20.0.1:49878 - "POST /node/69ffd5f18d5045ce94720e34 HTTP/1.0" 202 Accepted 2026-05-10 00:50:21,953 - lava_callback - INFO - Starting async job submit for node 69ffd5f18d5045ce94720e34 2026-05-10 00:50:22,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:22,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:22,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5f18d5045ce94720e34 HTTP/1.1" 200 None 2026-05-10 00:50:22,043 - lava_callback - DEBUG - Processing node 69ffd5f18d5045ce94720e34: baseline-arm64-broonie 2026-05-10 00:50:22,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:22,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c78d5045ce94720d8e/log.txt.gz 2026-05-10 00:50:22,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:22,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:22,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:22,654 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5f18d5045ce94720e34/log.txt.gz 2026-05-10 00:50:22,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:22,831 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c78d5045ce94720d8e/lava-logs.yaml 2026-05-10 00:50:22,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:22,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:22,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:22,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c78d5045ce94720d8e/lava_callback.json.gz 2026-05-10 00:50:22,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:22,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:22,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5f18d5045ce94720e34/lava-logs.yaml 2026-05-10 00:50:22,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:22,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c78d5045ce94720d8e HTTP/1.1" 200 None 2026-05-10 00:50:22,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:23,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:23,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c78d5045ce94720d8e HTTP/1.1" 200 None 2026-05-10 00:50:23,030 - lava_callback - INFO - Completed processing callback for node 69ffd5c78d5045ce94720d8e 2026-05-10 00:50:23,090 - lava_callback - INFO - Received callback for node 69ffd5fb8d5045ce94720e55 INFO: 172.20.0.1:49894 - "POST /node/69ffd5fb8d5045ce94720e55 HTTP/1.0" 202 Accepted 2026-05-10 00:50:23,101 - lava_callback - INFO - Starting async job submit for node 69ffd5fb8d5045ce94720e55 2026-05-10 00:50:23,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:23,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:23,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5f18d5045ce94720e34/lava_callback.json.gz 2026-05-10 00:50:23,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:23,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5fb8d5045ce94720e55 HTTP/1.1" 200 None 2026-05-10 00:50:23,169 - lava_callback - DEBUG - Processing node 69ffd5fb8d5045ce94720e55: baseline-arm64-kontron 2026-05-10 00:50:23,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5f18d5045ce94720e34 HTTP/1.1" 200 None 2026-05-10 00:50:23,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:23,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:23,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:23,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5f18d5045ce94720e34 HTTP/1.1" 200 None 2026-05-10 00:50:23,400 - lava_callback - INFO - Completed processing callback for node 69ffd5f18d5045ce94720e34 2026-05-10 00:50:23,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:23,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:23,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69ffd5fb8d5045ce94720e55/log.txt.gz 2026-05-10 00:50:23,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:23,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:23,905 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69ffd5fb8d5045ce94720e55/lava-logs.yaml 2026-05-10 00:50:23,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:24,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:24,014 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69ffd5fb8d5045ce94720e55/lava_callback.json.gz 2026-05-10 00:50:24,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:24,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5fb8d5045ce94720e55 HTTP/1.1" 200 None 2026-05-10 00:50:24,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:24,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:24,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:24,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5fb8d5045ce94720e55 HTTP/1.1" 200 None 2026-05-10 00:50:24,089 - lava_callback - INFO - Completed processing callback for node 69ffd5fb8d5045ce94720e55 INFO: 172.20.0.1:49906 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:50:29,714 - lava_callback - INFO - Received callback for node 69ffd5c38d5045ce94720d81 INFO: 172.20.0.1:34200 - "POST /node/69ffd5c38d5045ce94720d81 HTTP/1.0" 202 Accepted 2026-05-10 00:50:29,726 - lava_callback - INFO - Starting async job submit for node 69ffd5c38d5045ce94720d81 2026-05-10 00:50:29,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:29,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c38d5045ce94720d81 HTTP/1.1" 200 None 2026-05-10 00:50:29,774 - lava_callback - DEBUG - Processing node 69ffd5c38d5045ce94720d81: baseline-arm64 2026-05-10 00:50:29,961 - lava_callback - WARNING - Failed to upload log 2026-05-10 00:50:30,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:30,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:30,195 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c38d5045ce94720d81/lava-logs.yaml 2026-05-10 00:50:30,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:30,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:30,319 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c38d5045ce94720d81/lava_callback.json.gz 2026-05-10 00:50:30,353 - lava_callback - INFO - Received callback for node 69ffd5ca8d5045ce94720da7 INFO: 172.20.0.1:34206 - "POST /node/69ffd5ca8d5045ce94720da7 HTTP/1.0" 202 Accepted 2026-05-10 00:50:30,364 - lava_callback - INFO - Starting async job submit for node 69ffd5ca8d5045ce94720da7 2026-05-10 00:50:30,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:30,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:30,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c38d5045ce94720d81 HTTP/1.1" 200 None 2026-05-10 00:50:30,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:30,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ca8d5045ce94720da7 HTTP/1.1" 200 None 2026-05-10 00:50:30,416 - lava_callback - DEBUG - Processing node 69ffd5ca8d5045ce94720da7: baseline-arm64 2026-05-10 00:50:30,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:30,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:30,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c38d5045ce94720d81 HTTP/1.1" 200 None 2026-05-10 00:50:30,738 - lava_callback - INFO - Completed processing callback for node 69ffd5c38d5045ce94720d81 2026-05-10 00:50:31,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:31,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:31,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 00:50:31,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:31,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5ca8d5045ce94720da7/log.txt.gz 2026-05-10 00:50:31,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:31,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:31,589 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5ca8d5045ce94720da7/lava-logs.yaml 2026-05-10 00:50:31,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:31,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:31,724 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5ca8d5045ce94720da7/lava_callback.json.gz 2026-05-10 00:50:31,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:31,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ca8d5045ce94720da7 HTTP/1.1" 200 None 2026-05-10 00:50:31,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:31,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:31,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:31,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5ca8d5045ce94720da7 HTTP/1.1" 200 None 2026-05-10 00:50:31,794 - lava_callback - INFO - Completed processing callback for node 69ffd5ca8d5045ce94720da7 2026-05-10 00:50:33,134 - lava_callback - INFO - Received callback for node 69ffd5cc8d5045ce94720daf INFO: 172.20.0.1:34218 - "POST /node/69ffd5cc8d5045ce94720daf HTTP/1.0" 202 Accepted 2026-05-10 00:50:33,144 - lava_callback - INFO - Starting async job submit for node 69ffd5cc8d5045ce94720daf 2026-05-10 00:50:33,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:33,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5cc8d5045ce94720daf HTTP/1.1" 200 None 2026-05-10 00:50:33,182 - lava_callback - DEBUG - Processing node 69ffd5cc8d5045ce94720daf: baseline-arm64 2026-05-10 00:50:33,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:33,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:33,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cc8d5045ce94720daf/log.txt.gz 2026-05-10 00:50:33,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:33,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:33,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cc8d5045ce94720daf/lava-logs.yaml 2026-05-10 00:50:33,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:33,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:33,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cc8d5045ce94720daf/lava_callback.json.gz 2026-05-10 00:50:33,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:33,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5cc8d5045ce94720daf HTTP/1.1" 200 None 2026-05-10 00:50:33,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:33,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:33,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:34,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5cc8d5045ce94720daf HTTP/1.1" 200 None 2026-05-10 00:50:34,016 - lava_callback - INFO - Completed processing callback for node 69ffd5cc8d5045ce94720daf INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:50:37,507 - lava_callback - INFO - Received callback for node 69ffd5d08d5045ce94720db8 INFO: 172.20.0.1:34228 - "POST /node/69ffd5d08d5045ce94720db8 HTTP/1.0" 202 Accepted 2026-05-10 00:50:37,514 - lava_callback - INFO - Starting async job submit for node 69ffd5d08d5045ce94720db8 2026-05-10 00:50:37,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:37,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d08d5045ce94720db8 HTTP/1.1" 200 None 2026-05-10 00:50:37,551 - lava_callback - DEBUG - Processing node 69ffd5d08d5045ce94720db8: baseline-arm64 2026-05-10 00:50:37,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:38,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:38,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5d08d5045ce94720db8/log.txt.gz 2026-05-10 00:50:38,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:38,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:38,490 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5d08d5045ce94720db8/lava-logs.yaml 2026-05-10 00:50:38,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:38,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:38,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5d08d5045ce94720db8/lava_callback.json.gz 2026-05-10 00:50:38,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:38,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d08d5045ce94720db8 HTTP/1.1" 200 None 2026-05-10 00:50:38,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:38,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:38,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:38,705 - lava_callback - INFO - Received callback for node 69ffd5ff8d5045ce94720e66 INFO: 172.20.0.1:34236 - "POST /node/69ffd5ff8d5045ce94720e66 HTTP/1.0" 202 Accepted 2026-05-10 00:50:38,712 - lava_callback - INFO - Starting async job submit for node 69ffd5ff8d5045ce94720e66 2026-05-10 00:50:38,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d08d5045ce94720db8 HTTP/1.1" 200 None 2026-05-10 00:50:38,751 - lava_callback - INFO - Completed processing callback for node 69ffd5d08d5045ce94720db8 2026-05-10 00:50:38,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ff8d5045ce94720e66 HTTP/1.1" 200 None 2026-05-10 00:50:38,766 - lava_callback - DEBUG - Processing node 69ffd5ff8d5045ce94720e66: baseline-arm64-pengutronix 2026-05-10 00:50:39,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:39,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:39,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5ff8d5045ce94720e66/log.txt.gz 2026-05-10 00:50:39,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:39,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:39,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5ff8d5045ce94720e66/lava-logs.yaml 2026-05-10 00:50:39,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:39,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:39,514 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ffd5ff8d5045ce94720e66/lava_callback.json.gz 2026-05-10 00:50:39,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:39,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ff8d5045ce94720e66 HTTP/1.1" 200 None 2026-05-10 00:50:39,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:39,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:39,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:39,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5ff8d5045ce94720e66 HTTP/1.1" 200 None 2026-05-10 00:50:39,596 - lava_callback - INFO - Completed processing callback for node 69ffd5ff8d5045ce94720e66 2026-05-10 00:50:40,053 - lava_callback - INFO - Received callback for node 69ffd5ef8d5045ce94720e2d INFO: 172.20.0.1:35668 - "POST /node/69ffd5ef8d5045ce94720e2d HTTP/1.0" 202 Accepted 2026-05-10 00:50:40,063 - lava_callback - INFO - Starting async job submit for node 69ffd5ef8d5045ce94720e2d 2026-05-10 00:50:40,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:40,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ef8d5045ce94720e2d HTTP/1.1" 200 None 2026-05-10 00:50:40,103 - lava_callback - DEBUG - Processing node 69ffd5ef8d5045ce94720e2d: baseline-arm64-broonie 2026-05-10 00:50:40,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:40,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:40,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ef8d5045ce94720e2d/log.txt.gz 2026-05-10 00:50:40,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:40,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:40,924 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ef8d5045ce94720e2d/lava-logs.yaml 2026-05-10 00:50:40,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:41,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:41,035 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ef8d5045ce94720e2d/lava_callback.json.gz 2026-05-10 00:50:41,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:41,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ef8d5045ce94720e2d HTTP/1.1" 200 None 2026-05-10 00:50:41,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:41,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:41,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:41,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5ef8d5045ce94720e2d HTTP/1.1" 200 None 2026-05-10 00:50:41,128 - lava_callback - INFO - Completed processing callback for node 69ffd5ef8d5045ce94720e2d 2026-05-10 00:50:42,400 - lava_callback - INFO - Received callback for node 69ffd5ce8d5045ce94720db5 INFO: 172.20.0.1:35682 - "POST /node/69ffd5ce8d5045ce94720db5 HTTP/1.0" 202 Accepted 2026-05-10 00:50:42,407 - lava_callback - INFO - Starting async job submit for node 69ffd5ce8d5045ce94720db5 2026-05-10 00:50:42,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:42,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ce8d5045ce94720db5 HTTP/1.1" 200 None 2026-05-10 00:50:42,451 - lava_callback - DEBUG - Processing node 69ffd5ce8d5045ce94720db5: baseline-arm64 2026-05-10 00:50:42,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:42,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:42,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5ce8d5045ce94720db5/log.txt.gz 2026-05-10 00:50:42,851 - lava_callback - INFO - Received callback for node 69ffd5c68d5045ce94720d8a INFO: 172.20.0.1:35684 - "POST /node/69ffd5c68d5045ce94720d8a HTTP/1.0" 202 Accepted 2026-05-10 00:50:42,878 - lava_callback - INFO - Starting async job submit for node 69ffd5c68d5045ce94720d8a 2026-05-10 00:50:42,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:43,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c68d5045ce94720d8a HTTP/1.1" 200 None 2026-05-10 00:50:43,005 - lava_callback - DEBUG - Processing node 69ffd5c68d5045ce94720d8a: baseline-arm64 2026-05-10 00:50:43,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:43,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:43,300 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5ce8d5045ce94720db5/lava-logs.yaml 2026-05-10 00:50:43,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:43,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:43,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:43,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c68d5045ce94720d8a/log.txt.gz 2026-05-10 00:50:43,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:43,453 - lava_callback - INFO - Received callback for node 69ffd5cd8d5045ce94720db2 INFO: 172.20.0.1:35690 - "POST /node/69ffd5cd8d5045ce94720db2 HTTP/1.0" 202 Accepted 2026-05-10 00:50:43,471 - lava_callback - INFO - Starting async job submit for node 69ffd5cd8d5045ce94720db2 2026-05-10 00:50:43,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5ce8d5045ce94720db5/lava_callback.json.gz 2026-05-10 00:50:43,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:43,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:43,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ce8d5045ce94720db5 HTTP/1.1" 200 None 2026-05-10 00:50:43,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:43,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:43,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5cd8d5045ce94720db2 HTTP/1.1" 200 None 2026-05-10 00:50:43,662 - lava_callback - DEBUG - Processing node 69ffd5cd8d5045ce94720db2: baseline-arm64 2026-05-10 00:50:43,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:43,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:43,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:43,878 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c68d5045ce94720d8a/lava-logs.yaml 2026-05-10 00:50:43,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5ce8d5045ce94720db5 HTTP/1.1" 200 None 2026-05-10 00:50:43,906 - lava_callback - INFO - Completed processing callback for node 69ffd5ce8d5045ce94720db5 2026-05-10 00:50:43,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:44,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:44,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:44,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c68d5045ce94720d8a/lava_callback.json.gz 2026-05-10 00:50:44,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:44,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c68d5045ce94720d8a HTTP/1.1" 200 None 2026-05-10 00:50:44,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:44,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:44,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:44,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c68d5045ce94720d8a HTTP/1.1" 200 None 2026-05-10 00:50:44,201 - lava_callback - INFO - Completed processing callback for node 69ffd5c68d5045ce94720d8a 2026-05-10 00:50:44,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:44,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cd8d5045ce94720db2/log.txt.gz 2026-05-10 00:50:44,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:44,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:44,560 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cd8d5045ce94720db2/lava-logs.yaml 2026-05-10 00:50:44,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:44,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:44,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5cd8d5045ce94720db2/lava_callback.json.gz 2026-05-10 00:50:44,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:44,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5cd8d5045ce94720db2 HTTP/1.1" 200 None 2026-05-10 00:50:44,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:44,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:44,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:44,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5cd8d5045ce94720db2 HTTP/1.1" 200 None 2026-05-10 00:50:44,756 - lava_callback - INFO - Completed processing callback for node 69ffd5cd8d5045ce94720db2 INFO: 172.20.0.1:35700 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:50:49,079 - lava_callback - INFO - Received callback for node 69ffd5d78d5045ce94720dca INFO: 172.20.0.1:35712 - "POST /node/69ffd5d78d5045ce94720dca HTTP/1.0" 202 Accepted 2026-05-10 00:50:49,086 - lava_callback - INFO - Starting async job submit for node 69ffd5d78d5045ce94720dca 2026-05-10 00:50:49,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:49,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d78d5045ce94720dca HTTP/1.1" 200 None 2026-05-10 00:50:49,131 - lava_callback - DEBUG - Processing node 69ffd5d78d5045ce94720dca: baseline-nfs-arm64 2026-05-10 00:50:49,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:49,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:49,744 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d78d5045ce94720dca/log.txt.gz 2026-05-10 00:50:50,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:50,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:50,208 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d78d5045ce94720dca/lava-logs.yaml 2026-05-10 00:50:50,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:50,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:50,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d78d5045ce94720dca/lava_callback.json.gz 2026-05-10 00:50:50,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:50,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d78d5045ce94720dca HTTP/1.1" 200 None 2026-05-10 00:50:50,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:50,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:50,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:50,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d78d5045ce94720dca HTTP/1.1" 200 None 2026-05-10 00:50:50,447 - lava_callback - INFO - Completed processing callback for node 69ffd5d78d5045ce94720dca 2026-05-10 00:50:54,010 - lava_callback - INFO - Received callback for node 69ffd5c98d5045ce94720da4 INFO: 172.20.0.1:35628 - "POST /node/69ffd5c98d5045ce94720da4 HTTP/1.0" 202 Accepted 2026-05-10 00:50:54,016 - lava_callback - INFO - Starting async job submit for node 69ffd5c98d5045ce94720da4 2026-05-10 00:50:54,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:54,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c98d5045ce94720da4 HTTP/1.1" 200 None 2026-05-10 00:50:54,054 - lava_callback - DEBUG - Processing node 69ffd5c98d5045ce94720da4: baseline-arm64 2026-05-10 00:50:54,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:54,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:54,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c98d5045ce94720da4/log.txt.gz 2026-05-10 00:50:54,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:55,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:55,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c98d5045ce94720da4/lava-logs.yaml 2026-05-10 00:50:55,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:55,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:55,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c98d5045ce94720da4/lava_callback.json.gz 2026-05-10 00:50:55,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:55,289 - lava_callback - INFO - Received callback for node 69ffd5d88d5045ce94720dd0 INFO: 172.20.0.1:35644 - "POST /node/69ffd5d88d5045ce94720dd0 HTTP/1.0" 202 Accepted 2026-05-10 00:50:55,301 - lava_callback - INFO - Starting async job submit for node 69ffd5d88d5045ce94720dd0 2026-05-10 00:50:55,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:55,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c98d5045ce94720da4 HTTP/1.1" 200 None 2026-05-10 00:50:55,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:55,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d88d5045ce94720dd0 HTTP/1.1" 200 None 2026-05-10 00:50:55,352 - lava_callback - DEBUG - Processing node 69ffd5d88d5045ce94720dd0: baseline-nfs-arm64 2026-05-10 00:50:55,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:55,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:55,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c98d5045ce94720da4 HTTP/1.1" 200 None 2026-05-10 00:50:55,518 - lava_callback - INFO - Completed processing callback for node 69ffd5c98d5045ce94720da4 2026-05-10 00:50:55,857 - lava_callback - INFO - Received callback for node 69ffd5c18d5045ce94720d7e INFO: 172.20.0.1:35652 - "POST /node/69ffd5c18d5045ce94720d7e HTTP/1.0" 202 Accepted 2026-05-10 00:50:55,869 - lava_callback - INFO - Starting async job submit for node 69ffd5c18d5045ce94720d7e 2026-05-10 00:50:55,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:56,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c18d5045ce94720d7e HTTP/1.1" 200 None 2026-05-10 00:50:56,054 - lava_callback - DEBUG - Processing node 69ffd5c18d5045ce94720d7e: baseline-arm64 2026-05-10 00:50:56,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:56,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:56,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:56,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d88d5045ce94720dd0/log.txt.gz INFO: 172.20.0.1:35660 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:50:56,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:56,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c18d5045ce94720d7e/log.txt.gz 2026-05-10 00:50:56,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:57,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:57,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:57,160 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c18d5045ce94720d7e/lava-logs.yaml 2026-05-10 00:50:57,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:57,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:57,195 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d88d5045ce94720dd0/lava-logs.yaml 2026-05-10 00:50:57,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:57,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:57,284 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c18d5045ce94720d7e/lava_callback.json.gz 2026-05-10 00:50:57,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:57,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:57,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d88d5045ce94720dd0/lava_callback.json.gz 2026-05-10 00:50:57,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c18d5045ce94720d7e HTTP/1.1" 200 None 2026-05-10 00:50:57,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:57,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:57,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:57,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:57,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d88d5045ce94720dd0 HTTP/1.1" 200 None 2026-05-10 00:50:57,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:57,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:57,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:57,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c18d5045ce94720d7e HTTP/1.1" 200 None 2026-05-10 00:50:57,414 - lava_callback - INFO - Completed processing callback for node 69ffd5c18d5045ce94720d7e 2026-05-10 00:50:57,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d88d5045ce94720dd0 HTTP/1.1" 200 None 2026-05-10 00:50:57,477 - lava_callback - INFO - Completed processing callback for node 69ffd5d88d5045ce94720dd0 2026-05-10 00:50:58,773 - lava_callback - INFO - Received callback for node 69ffd5de8d5045ce94720ddf INFO: 172.20.0.1:35676 - "POST /node/69ffd5de8d5045ce94720ddf HTTP/1.0" 202 Accepted 2026-05-10 00:50:58,784 - lava_callback - INFO - Starting async job submit for node 69ffd5de8d5045ce94720ddf 2026-05-10 00:50:58,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:58,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5de8d5045ce94720ddf HTTP/1.1" 200 None 2026-05-10 00:50:58,857 - lava_callback - DEBUG - Processing node 69ffd5de8d5045ce94720ddf: baseline-nfs-arm64 2026-05-10 00:50:59,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:59,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:59,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5de8d5045ce94720ddf/log.txt.gz 2026-05-10 00:50:59,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:59,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:59,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5de8d5045ce94720ddf/lava-logs.yaml 2026-05-10 00:50:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:50:59,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:50:59,872 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5de8d5045ce94720ddf/lava_callback.json.gz 2026-05-10 00:50:59,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:59,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5de8d5045ce94720ddf HTTP/1.1" 200 None 2026-05-10 00:50:59,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:59,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:50:59,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:50:59,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5de8d5045ce94720ddf HTTP/1.1" 200 None 2026-05-10 00:50:59,946 - lava_callback - INFO - Completed processing callback for node 69ffd5de8d5045ce94720ddf 2026-05-10 00:51:01,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:01,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-05-10 00:51:04,626 - lava_callback - INFO - Received callback for node 69ffd5dd8d5045ce94720ddc INFO: 172.20.0.1:44102 - "POST /node/69ffd5dd8d5045ce94720ddc HTTP/1.0" 202 Accepted 2026-05-10 00:51:04,634 - lava_callback - INFO - Starting async job submit for node 69ffd5dd8d5045ce94720ddc 2026-05-10 00:51:04,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:04,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5dd8d5045ce94720ddc HTTP/1.1" 200 None 2026-05-10 00:51:04,688 - lava_callback - DEBUG - Processing node 69ffd5dd8d5045ce94720ddc: baseline-nfs-arm64 2026-05-10 00:51:05,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:05,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:05,293 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5dd8d5045ce94720ddc/log.txt.gz 2026-05-10 00:51:05,441 - lava_callback - INFO - Received callback for node 69ffd5dc8d5045ce94720dd9 INFO: 172.20.0.1:44104 - "POST /node/69ffd5dc8d5045ce94720dd9 HTTP/1.0" 202 Accepted 2026-05-10 00:51:05,459 - lava_callback - INFO - Starting async job submit for node 69ffd5dc8d5045ce94720dd9 2026-05-10 00:51:05,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:05,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:05,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5dc8d5045ce94720dd9 HTTP/1.1" 200 None 2026-05-10 00:51:05,590 - lava_callback - DEBUG - Processing node 69ffd5dc8d5045ce94720dd9: baseline-nfs-arm64 2026-05-10 00:51:05,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:05,897 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5dd8d5045ce94720ddc/lava-logs.yaml 2026-05-10 00:51:06,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:06,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:06,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:06,162 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5dc8d5045ce94720dd9/log.txt.gz 2026-05-10 00:51:06,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:06,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5dd8d5045ce94720ddc/lava_callback.json.gz 2026-05-10 00:51:06,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:06,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5dd8d5045ce94720ddc HTTP/1.1" 200 None 2026-05-10 00:51:06,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:06,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:06,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:44118 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:51:06,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5dd8d5045ce94720ddc HTTP/1.1" 200 None 2026-05-10 00:51:06,557 - lava_callback - INFO - Completed processing callback for node 69ffd5dd8d5045ce94720ddc 2026-05-10 00:51:06,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:06,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:06,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5dc8d5045ce94720dd9/lava-logs.yaml 2026-05-10 00:51:06,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:06,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:06,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5dc8d5045ce94720dd9/lava_callback.json.gz 2026-05-10 00:51:06,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:06,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5dc8d5045ce94720dd9 HTTP/1.1" 200 None 2026-05-10 00:51:06,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:07,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:07,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:07,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5dc8d5045ce94720dd9 HTTP/1.1" 200 None 2026-05-10 00:51:07,045 - lava_callback - INFO - Completed processing callback for node 69ffd5dc8d5045ce94720dd9 2026-05-10 00:51:08,598 - lava_callback - INFO - Received callback for node 69ffd5c48d5045ce94720d84 INFO: 172.20.0.1:44120 - "POST /node/69ffd5c48d5045ce94720d84 HTTP/1.0" 202 Accepted 2026-05-10 00:51:08,605 - lava_callback - INFO - Starting async job submit for node 69ffd5c48d5045ce94720d84 2026-05-10 00:51:08,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:08,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c48d5045ce94720d84 HTTP/1.1" 200 None 2026-05-10 00:51:08,658 - lava_callback - DEBUG - Processing node 69ffd5c48d5045ce94720d84: baseline-arm64 2026-05-10 00:51:08,922 - lava_callback - INFO - Received callback for node 69ffd5da8d5045ce94720dd6 INFO: 172.20.0.1:44128 - "POST /node/69ffd5da8d5045ce94720dd6 HTTP/1.0" 202 Accepted 2026-05-10 00:51:08,939 - lava_callback - INFO - Starting async job submit for node 69ffd5da8d5045ce94720dd6 2026-05-10 00:51:08,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:08,995 - lava_callback - WARNING - Failed to upload log 2026-05-10 00:51:09,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5da8d5045ce94720dd6 HTTP/1.1" 200 None 2026-05-10 00:51:09,082 - lava_callback - DEBUG - Processing node 69ffd5da8d5045ce94720dd6: baseline-nfs-arm64 2026-05-10 00:51:09,152 - lava_callback - INFO - Received callback for node 69ffd5d48d5045ce94720dc4 INFO: 172.20.0.1:44134 - "POST /node/69ffd5d48d5045ce94720dc4 HTTP/1.0" 202 Accepted 2026-05-10 00:51:09,180 - lava_callback - INFO - Starting async job submit for node 69ffd5d48d5045ce94720dc4 2026-05-10 00:51:09,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:09,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:09,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d48d5045ce94720dc4 HTTP/1.1" 200 None 2026-05-10 00:51:09,388 - lava_callback - DEBUG - Processing node 69ffd5d48d5045ce94720dc4: baseline-nfs-arm64 2026-05-10 00:51:09,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:09,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c48d5045ce94720d84/lava-logs.yaml 2026-05-10 00:51:09,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:10,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:10,092 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5c48d5045ce94720d84/lava_callback.json.gz 2026-05-10 00:51:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:10,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:10,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5c48d5045ce94720d84 HTTP/1.1" 200 None 2026-05-10 00:51:10,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:10,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:10,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:10,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:10,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5c48d5045ce94720d84 HTTP/1.1" 200 None 2026-05-10 00:51:10,476 - lava_callback - INFO - Completed processing callback for node 69ffd5c48d5045ce94720d84 2026-05-10 00:51:10,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:10,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5da8d5045ce94720dd6/log.txt.gz 2026-05-10 00:51:10,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:10,598 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d48d5045ce94720dc4/log.txt.gz 2026-05-10 00:51:11,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:11,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:11,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:11,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5da8d5045ce94720dd6/lava-logs.yaml 2026-05-10 00:51:11,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:11,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:11,353 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d48d5045ce94720dc4/lava-logs.yaml 2026-05-10 00:51:11,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:11,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:11,466 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5da8d5045ce94720dd6/lava_callback.json.gz 2026-05-10 00:51:11,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:11,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:11,504 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d48d5045ce94720dc4/lava_callback.json.gz 2026-05-10 00:51:11,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:11,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5da8d5045ce94720dd6 HTTP/1.1" 200 None 2026-05-10 00:51:11,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:11,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d48d5045ce94720dc4 HTTP/1.1" 200 None 2026-05-10 00:51:11,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:11,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:11,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:11,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:11,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:11,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5da8d5045ce94720dd6 HTTP/1.1" 200 None 2026-05-10 00:51:11,643 - lava_callback - INFO - Completed processing callback for node 69ffd5da8d5045ce94720dd6 2026-05-10 00:51:11,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d48d5045ce94720dc4 HTTP/1.1" 200 None 2026-05-10 00:51:11,700 - lava_callback - INFO - Completed processing callback for node 69ffd5d48d5045ce94720dc4 2026-05-10 00:51:12,059 - lava_callback - INFO - Received callback for node 69ffd5f88d5045ce94720e48 INFO: 172.20.0.1:54816 - "POST /node/69ffd5f88d5045ce94720e48 HTTP/1.0" 202 Accepted 2026-05-10 00:51:12,067 - lava_callback - INFO - Starting async job submit for node 69ffd5f88d5045ce94720e48 2026-05-10 00:51:12,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:12,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5f88d5045ce94720e48 HTTP/1.1" 200 None 2026-05-10 00:51:12,124 - lava_callback - DEBUG - Processing node 69ffd5f88d5045ce94720e48: baseline-arm64-clabbe 2026-05-10 00:51:12,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:12,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:12,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ffd5f88d5045ce94720e48/log.txt.gz 2026-05-10 00:51:12,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:12,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:12,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ffd5f88d5045ce94720e48/lava-logs.yaml 2026-05-10 00:51:12,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:12,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:12,956 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ffd5f88d5045ce94720e48/lava_callback.json.gz 2026-05-10 00:51:12,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:13,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5f88d5045ce94720e48 HTTP/1.1" 200 None 2026-05-10 00:51:13,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:13,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:13,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:13,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5f88d5045ce94720e48 HTTP/1.1" 200 None 2026-05-10 00:51:13,093 - lava_callback - INFO - Completed processing callback for node 69ffd5f88d5045ce94720e48 INFO: 172.20.0.1:54824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54840 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:51:17,475 - lava_callback - INFO - Received callback for node 69ffd5e88d5045ce94720e1a INFO: 172.20.0.1:54846 - "POST /node/69ffd5e88d5045ce94720e1a HTTP/1.0" 202 Accepted 2026-05-10 00:51:17,485 - lava_callback - INFO - Starting async job submit for node 69ffd5e88d5045ce94720e1a 2026-05-10 00:51:17,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:17,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5e88d5045ce94720e1a HTTP/1.1" 200 None 2026-05-10 00:51:17,539 - lava_callback - DEBUG - Processing node 69ffd5e88d5045ce94720e1a: baseline-arm64-broonie 2026-05-10 00:51:17,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:17,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:17,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5e88d5045ce94720e1a/log.txt.gz 2026-05-10 00:51:18,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:18,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:18,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5e88d5045ce94720e1a/lava-logs.yaml 2026-05-10 00:51:18,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:18,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:18,389 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5e88d5045ce94720e1a/lava_callback.json.gz 2026-05-10 00:51:18,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:18,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5e88d5045ce94720e1a HTTP/1.1" 200 None 2026-05-10 00:51:18,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:18,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:18,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:18,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5e88d5045ce94720e1a HTTP/1.1" 200 None 2026-05-10 00:51:18,528 - lava_callback - INFO - Completed processing callback for node 69ffd5e88d5045ce94720e1a INFO: 172.20.0.1:44086 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:51:22,203 - lava_callback - INFO - Received callback for node 69ffd5d28d5045ce94720dbe INFO: 172.20.0.1:44094 - "POST /node/69ffd5d28d5045ce94720dbe HTTP/1.0" 202 Accepted 2026-05-10 00:51:22,211 - lava_callback - INFO - Starting async job submit for node 69ffd5d28d5045ce94720dbe 2026-05-10 00:51:22,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:22,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d28d5045ce94720dbe HTTP/1.1" 200 None 2026-05-10 00:51:22,260 - lava_callback - DEBUG - Processing node 69ffd5d28d5045ce94720dbe: baseline-nfs-arm64 2026-05-10 00:51:22,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:22,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:22,764 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d28d5045ce94720dbe/log.txt.gz 2026-05-10 00:51:22,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:23,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:23,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d28d5045ce94720dbe/lava-logs.yaml 2026-05-10 00:51:23,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:51:23,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:51:23,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d28d5045ce94720dbe/lava_callback.json.gz 2026-05-10 00:51:23,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:23,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d28d5045ce94720dbe HTTP/1.1" 200 None 2026-05-10 00:51:23,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:23,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:51:23,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:23,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d28d5045ce94720dbe HTTP/1.1" 200 None 2026-05-10 00:51:23,376 - lava_callback - INFO - Completed processing callback for node 69ffd5d28d5045ce94720dbe INFO: 172.20.0.1:44098 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:51:31,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:31,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38754 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:51:59,871 - lava_callback - INFO - Received callback for node 69ffd5ea8d5045ce94720e21 INFO: 172.20.0.1:33162 - "POST /node/69ffd5ea8d5045ce94720e21 HTTP/1.0" 202 Accepted 2026-05-10 00:51:59,879 - lava_callback - INFO - Starting async job submit for node 69ffd5ea8d5045ce94720e21 2026-05-10 00:51:59,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:51:59,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ea8d5045ce94720e21 HTTP/1.1" 200 None 2026-05-10 00:51:59,937 - lava_callback - DEBUG - Processing node 69ffd5ea8d5045ce94720e21: baseline-arm64-broonie 2026-05-10 00:52:00,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:52:00,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:52:00,394 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ea8d5045ce94720e21/log.txt.gz 2026-05-10 00:52:00,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:52:00,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:52:00,780 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ea8d5045ce94720e21/lava-logs.yaml 2026-05-10 00:52:00,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:52:00,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:52:00,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ea8d5045ce94720e21/lava_callback.json.gz 2026-05-10 00:52:00,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:00,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ea8d5045ce94720e21 HTTP/1.1" 200 None 2026-05-10 00:52:00,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:00,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:52:00,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:00,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5ea8d5045ce94720e21 HTTP/1.1" 200 None 2026-05-10 00:52:00,999 - lava_callback - INFO - Completed processing callback for node 69ffd5ea8d5045ce94720e21 2026-05-10 00:52:01,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:01,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52208 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:52:17,512 - lava_callback - INFO - Received callback for node 69ffd5ec8d5045ce94720e27 INFO: 172.20.0.1:52220 - "POST /node/69ffd5ec8d5045ce94720e27 HTTP/1.0" 202 Accepted 2026-05-10 00:52:17,523 - lava_callback - INFO - Starting async job submit for node 69ffd5ec8d5045ce94720e27 2026-05-10 00:52:17,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:17,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ec8d5045ce94720e27 HTTP/1.1" 200 None 2026-05-10 00:52:17,637 - lava_callback - DEBUG - Processing node 69ffd5ec8d5045ce94720e27: baseline-arm64-broonie 2026-05-10 00:52:18,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:52:18,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:52:18,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ec8d5045ce94720e27/log.txt.gz 2026-05-10 00:52:18,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:52:18,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:52:18,553 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ec8d5045ce94720e27/lava-logs.yaml 2026-05-10 00:52:18,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:52:18,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:52:18,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5ec8d5045ce94720e27/lava_callback.json.gz 2026-05-10 00:52:18,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:18,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5ec8d5045ce94720e27 HTTP/1.1" 200 None 2026-05-10 00:52:18,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:18,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:52:18,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:18,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5ec8d5045ce94720e27 HTTP/1.1" 200 None 2026-05-10 00:52:18,953 - lava_callback - INFO - Completed processing callback for node 69ffd5ec8d5045ce94720e27 INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:52:31,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:52:31,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55994 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:53:17,971 - lava_callback - INFO - Received callback for node 69ffd25d8d5045ce94720a9e INFO: 172.20.0.1:55998 - "POST /node/69ffd25d8d5045ce94720a9e HTTP/1.0" 202 Accepted 2026-05-10 00:53:17,984 - lava_callback - INFO - Starting async job submit for node 69ffd25d8d5045ce94720a9e 2026-05-10 00:53:18,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:53:18,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd25d8d5045ce94720a9e HTTP/1.1" 200 None 2026-05-10 00:53:18,142 - lava_callback - DEBUG - Processing node 69ffd25d8d5045ce94720a9e: ltp-smoke 2026-05-10 00:53:19,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:53:19,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:53:19,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffd25d8d5045ce94720a9e/log.txt.gz 2026-05-10 00:53:19,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:53:20,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:53:20,081 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffd25d8d5045ce94720a9e/lava-logs.yaml 2026-05-10 00:53:20,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:53:20,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:53:20,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffd25d8d5045ce94720a9e/lava_callback.json.gz 2026-05-10 00:53:20,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:53:20,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd25d8d5045ce94720a9e HTTP/1.1" 200 None 2026-05-10 00:53:20,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:53:20,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce858d5045ce9471e366 HTTP/1.1" 200 None 2026-05-10 00:53:20,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:53:20,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd25d8d5045ce94720a9e HTTP/1.1" 200 None 2026-05-10 00:53:21,056 - lava_callback - INFO - Completed processing callback for node 69ffd25d8d5045ce94720a9e INFO: 172.20.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34276 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:53:31,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:53:31,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36760 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:53:57,829 - lava_callback - INFO - Received callback for node 69ffd46d8d5045ce94720c1c INFO: 172.20.0.1:36768 - "POST /node/69ffd46d8d5045ce94720c1c HTTP/1.0" 202 Accepted 2026-05-10 00:53:57,840 - lava_callback - INFO - Starting async job submit for node 69ffd46d8d5045ce94720c1c 2026-05-10 00:53:57,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:53:57,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46d8d5045ce94720c1c HTTP/1.1" 200 None 2026-05-10 00:53:57,919 - lava_callback - DEBUG - Processing node 69ffd46d8d5045ce94720c1c: ltp-smoke 2026-05-10 00:53:58,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:53:58,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:53:58,791 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffd46d8d5045ce94720c1c/log.txt.gz 2026-05-10 00:53:59,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:53:59,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:53:59,881 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffd46d8d5045ce94720c1c/lava-logs.yaml 2026-05-10 00:53:59,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:00,123 - lava_callback - INFO - Received callback for node 69ffd46c8d5045ce94720c19 INFO: 172.20.0.1:55012 - "POST /node/69ffd46c8d5045ce94720c19 HTTP/1.0" 202 Accepted 2026-05-10 00:54:00,135 - lava_callback - INFO - Starting async job submit for node 69ffd46c8d5045ce94720c19 2026-05-10 00:54:00,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:00,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46c8d5045ce94720c19 HTTP/1.1" 200 None 2026-05-10 00:54:00,224 - lava_callback - DEBUG - Processing node 69ffd46c8d5045ce94720c19: ltp-sched 2026-05-10 00:54:00,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:00,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffd46d8d5045ce94720c1c/lava_callback.json.gz 2026-05-10 00:54:00,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:00,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46d8d5045ce94720c1c HTTP/1.1" 200 None 2026-05-10 00:54:00,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:00,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:54:00,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:00,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd46d8d5045ce94720c1c HTTP/1.1" 200 None 2026-05-10 00:54:00,700 - lava_callback - INFO - Completed processing callback for node 69ffd46d8d5045ce94720c1c 2026-05-10 00:54:01,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:01,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:01,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ffd46c8d5045ce94720c19/log.txt.gz 2026-05-10 00:54:01,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:01,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 00:54:01,737 - lava_callback - INFO - Received callback for node 69ffd4718d5045ce94720c22 INFO: 172.20.0.1:55014 - "POST /node/69ffd4718d5045ce94720c22 HTTP/1.0" 202 Accepted 2026-05-10 00:54:01,748 - lava_callback - INFO - Starting async job submit for node 69ffd4718d5045ce94720c22 2026-05-10 00:54:01,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:01,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:01,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4718d5045ce94720c22 HTTP/1.1" 200 None 2026-05-10 00:54:01,840 - lava_callback - DEBUG - Processing node 69ffd4718d5045ce94720c22: ltp-syscalls-ipc 2026-05-10 00:54:02,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:02,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:02,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ffd46c8d5045ce94720c19/lava-logs.yaml 2026-05-10 00:54:02,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:02,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:02,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ffd4718d5045ce94720c22/log.txt.gz 2026-05-10 00:54:03,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:03,123 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ffd46c8d5045ce94720c19/lava_callback.json.gz 2026-05-10 00:54:03,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:03,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46c8d5045ce94720c19 HTTP/1.1" 200 None 2026-05-10 00:54:03,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:03,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:03,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:54:03,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:03,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd46c8d5045ce94720c19 HTTP/1.1" 200 None 2026-05-10 00:54:03,431 - lava_callback - INFO - Completed processing callback for node 69ffd46c8d5045ce94720c19 2026-05-10 00:54:04,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:04,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ffd4718d5045ce94720c22/lava-logs.yaml 2026-05-10 00:54:04,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:04,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:04,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ffd4718d5045ce94720c22/lava_callback.json.gz 2026-05-10 00:54:04,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:04,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4718d5045ce94720c22 HTTP/1.1" 200 None 2026-05-10 00:54:04,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:04,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:54:04,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:04,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4718d5045ce94720c22 HTTP/1.1" 200 None 2026-05-10 00:54:04,447 - lava_callback - INFO - Completed processing callback for node 69ffd4718d5045ce94720c22 INFO: 172.20.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57514 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:54:21,174 - lava_callback - INFO - Received callback for node 69ffd46a8d5045ce94720c16 INFO: 172.20.0.1:57530 - "POST /node/69ffd46a8d5045ce94720c16 HTTP/1.0" 202 Accepted 2026-05-10 00:54:21,238 - lava_callback - INFO - Starting async job submit for node 69ffd46a8d5045ce94720c16 2026-05-10 00:54:21,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:21,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46a8d5045ce94720c16 HTTP/1.1" 200 None 2026-05-10 00:54:21,322 - lava_callback - DEBUG - Processing node 69ffd46a8d5045ce94720c16: ltp-pty INFO: 172.20.0.1:57532 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:54:31,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:31,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41490 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:54:39,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:39,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:39,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ffd46a8d5045ce94720c16/log.txt.gz INFO: 172.20.0.1:39156 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:54:48,639 - lava_callback - INFO - Received callback for node 69ffd6018d5045ce94720e6c INFO: 172.20.0.1:39168 - "POST /node/69ffd6018d5045ce94720e6c HTTP/1.0" 202 Accepted 2026-05-10 00:54:48,682 - lava_callback - INFO - Starting async job submit for node 69ffd6018d5045ce94720e6c 2026-05-10 00:54:48,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:48,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd6018d5045ce94720e6c HTTP/1.1" 200 None 2026-05-10 00:54:49,002 - lava_callback - DEBUG - Processing node 69ffd6018d5045ce94720e6c: baseline-arm64-foundriesio 2026-05-10 00:54:49,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:50,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:50,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ffd46a8d5045ce94720c16/lava-logs.yaml 2026-05-10 00:54:50,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:50,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:51,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ffd46a8d5045ce94720c16/lava_callback.json.gz 2026-05-10 00:54:51,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:51,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd46a8d5045ce94720c16 HTTP/1.1" 200 None 2026-05-10 00:54:51,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:51,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:54:51,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:51,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd46a8d5045ce94720c16 HTTP/1.1" 200 None 2026-05-10 00:54:51,345 - lava_callback - INFO - Completed processing callback for node 69ffd46a8d5045ce94720c16 2026-05-10 00:54:51,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:51,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:51,818 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffd6018d5045ce94720e6c/log.txt.gz 2026-05-10 00:54:53,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:53,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:53,354 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffd6018d5045ce94720e6c/lava-logs.yaml 2026-05-10 00:54:53,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:54:53,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:54:53,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffd6018d5045ce94720e6c/lava_callback.json.gz DEBUG: Setup failed for 69ffd6018d5045ce94720e6c. Transitting job node result: incomplete -> fail 2026-05-10 00:54:53,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:53,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd6018d5045ce94720e6c HTTP/1.1" 200 None 2026-05-10 00:54:53,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:53,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:54:53,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:53,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd6018d5045ce94720e6c HTTP/1.1" 200 None 2026-05-10 00:54:54,032 - lava_callback - INFO - Completed processing callback for node 69ffd6018d5045ce94720e6c INFO: 172.20.0.1:44452 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:54:57,010 - lava_callback - INFO - Received callback for node 69fd345a197af08e45fc587b INFO: 172.20.0.1:44464 - "POST /node/69fd345a197af08e45fc587b HTTP/1.0" 202 Accepted 2026-05-10 00:54:57,016 - lava_callback - INFO - Starting async job submit for node 69fd345a197af08e45fc587b 2026-05-10 00:54:57,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:57,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd345a197af08e45fc587b HTTP/1.1" 200 None 2026-05-10 00:54:57,037 - lava_callback - DEBUG - Processing node 69fd345a197af08e45fc587b: baseline-arm-baylibre 2026-05-10 00:54:57,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd345a197af08e45fc587b 2026-05-10 00:54:57,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:57,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd345a197af08e45fc587b HTTP/1.1" 200 None 2026-05-10 00:54:57,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:57,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:54:57,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:54:57,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd345a197af08e45fc587b HTTP/1.1" 200 None 2026-05-10 00:54:57,102 - lava_callback - ERROR - Error processing callback for node 69fd345a197af08e45fc587b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:55:01,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:55:01,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35562 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:55:36,939 - lava_callback - INFO - Received callback for node 69fd347f197af08e45fc5886 INFO: 172.20.0.1:35570 - "POST /node/69fd347f197af08e45fc5886 HTTP/1.0" 202 Accepted 2026-05-10 00:55:36,949 - lava_callback - INFO - Starting async job submit for node 69fd347f197af08e45fc5886 2026-05-10 00:55:36,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:55:36,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd347f197af08e45fc5886 HTTP/1.1" 200 None 2026-05-10 00:55:36,975 - lava_callback - DEBUG - Processing node 69fd347f197af08e45fc5886: baseline-arm-baylibre 2026-05-10 00:55:36,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd347f197af08e45fc5886 2026-05-10 00:55:36,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:55:37,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd347f197af08e45fc5886 HTTP/1.1" 200 None 2026-05-10 00:55:37,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:55:37,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:55:37,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:55:37,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd347f197af08e45fc5886 HTTP/1.1" 200 None 2026-05-10 00:55:37,045 - lava_callback - ERROR - Error processing callback for node 69fd347f197af08e45fc5886: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59842 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:56:17,049 - lava_callback - INFO - Received callback for node 69fd34a4197af08e45fc5898 INFO: 172.20.0.1:59854 - "POST /node/69fd34a4197af08e45fc5898 HTTP/1.0" 202 Accepted 2026-05-10 00:56:17,055 - lava_callback - INFO - Starting async job submit for node 69fd34a4197af08e45fc5898 2026-05-10 00:56:17,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:17,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd34a4197af08e45fc5898 HTTP/1.1" 200 None 2026-05-10 00:56:17,070 - lava_callback - DEBUG - Processing node 69fd34a4197af08e45fc5898: baseline-arm-baylibre 2026-05-10 00:56:17,071 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd34a4197af08e45fc5898 2026-05-10 00:56:17,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:17,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd34a4197af08e45fc5898 HTTP/1.1" 200 None 2026-05-10 00:56:17,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:17,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:56:17,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:17,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd34a4197af08e45fc5898 HTTP/1.1" 200 None 2026-05-10 00:56:17,117 - lava_callback - ERROR - Error processing callback for node 69fd34a4197af08e45fc5898: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40710 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:56:52,202 - lava_callback - INFO - Received callback for node 69ffd5d18d5045ce94720dbb INFO: 172.20.0.1:59236 - "POST /node/69ffd5d18d5045ce94720dbb HTTP/1.0" 202 Accepted 2026-05-10 00:56:52,209 - lava_callback - INFO - Starting async job submit for node 69ffd5d18d5045ce94720dbb 2026-05-10 00:56:52,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:52,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d18d5045ce94720dbb HTTP/1.1" 200 None 2026-05-10 00:56:52,262 - lava_callback - DEBUG - Processing node 69ffd5d18d5045ce94720dbb: baseline-arm64 2026-05-10 00:56:52,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:56:52,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:56:52,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5d18d5045ce94720dbb/log.txt.gz 2026-05-10 00:56:52,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:56:53,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:56:53,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5d18d5045ce94720dbb/lava-logs.yaml 2026-05-10 00:56:53,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:56:53,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:56:53,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffd5d18d5045ce94720dbb/lava_callback.json.gz DEBUG: Setup failed for 69ffd5d18d5045ce94720dbb. Transitting job node result: incomplete -> fail 2026-05-10 00:56:53,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:53,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d18d5045ce94720dbb HTTP/1.1" 200 None 2026-05-10 00:56:53,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:53,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 00:56:53,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:56:53,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d18d5045ce94720dbb HTTP/1.1" 200 None 2026-05-10 00:56:53,449 - lava_callback - INFO - Completed processing callback for node 69ffd5d18d5045ce94720dbb INFO: 172.20.0.1:59244 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:57:01,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:01,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33280 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:57:37,279 - lava_callback - INFO - Received callback for node 69fd34ee197af08e45fc58c1 INFO: 172.20.0.1:33294 - "POST /node/69fd34ee197af08e45fc58c1 HTTP/1.0" 202 Accepted 2026-05-10 00:57:37,288 - lava_callback - INFO - Starting async job submit for node 69fd34ee197af08e45fc58c1 2026-05-10 00:57:37,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:37,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd34ee197af08e45fc58c1 HTTP/1.1" 200 None 2026-05-10 00:57:37,311 - lava_callback - DEBUG - Processing node 69fd34ee197af08e45fc58c1: baseline-arm-baylibre 2026-05-10 00:57:37,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd34ee197af08e45fc58c1 2026-05-10 00:57:37,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:37,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd34ee197af08e45fc58c1 HTTP/1.1" 200 None 2026-05-10 00:57:37,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:37,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:57:37,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:37,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd34ee197af08e45fc58c1 HTTP/1.1" 200 None 2026-05-10 00:57:37,388 - lava_callback - ERROR - Error processing callback for node 69fd34ee197af08e45fc58c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:57:57,066 - lava_callback - INFO - Received callback for node 69fd3513197af08e45fc58d9 INFO: 172.20.0.1:40250 - "POST /node/69fd3513197af08e45fc58d9 HTTP/1.0" 202 Accepted 2026-05-10 00:57:57,074 - lava_callback - INFO - Starting async job submit for node 69fd3513197af08e45fc58d9 2026-05-10 00:57:57,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:57,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3513197af08e45fc58d9 HTTP/1.1" 200 None 2026-05-10 00:57:57,097 - lava_callback - DEBUG - Processing node 69fd3513197af08e45fc58d9: baseline-arm-baylibre 2026-05-10 00:57:57,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3513197af08e45fc58d9 2026-05-10 00:57:57,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:57,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3513197af08e45fc58d9 HTTP/1.1" 200 None 2026-05-10 00:57:57,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:57,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:57:57,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:57,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3513197af08e45fc58d9 HTTP/1.1" 200 None 2026-05-10 00:57:57,172 - lava_callback - ERROR - Error processing callback for node 69fd3513197af08e45fc58d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:57:58,177 - lava_callback - INFO - Received callback for node 69ffd4728d5045ce94720c25 INFO: 172.20.0.1:40260 - "POST /node/69ffd4728d5045ce94720c25 HTTP/1.0" 202 Accepted 2026-05-10 00:57:58,185 - lava_callback - INFO - Starting async job submit for node 69ffd4728d5045ce94720c25 2026-05-10 00:57:58,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:58,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4728d5045ce94720c25 HTTP/1.1" 200 None 2026-05-10 00:57:58,243 - lava_callback - DEBUG - Processing node 69ffd4728d5045ce94720c25: ltp-timers 2026-05-10 00:57:58,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:57:58,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:57:58,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ffd4728d5045ce94720c25/log.txt.gz 2026-05-10 00:57:58,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:57:59,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:57:59,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ffd4728d5045ce94720c25/lava-logs.yaml 2026-05-10 00:57:59,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:57:59,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:57:59,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ffd4728d5045ce94720c25/lava_callback.json.gz 2026-05-10 00:57:59,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:59,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4728d5045ce94720c25 HTTP/1.1" 200 None 2026-05-10 00:57:59,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:59,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:57:59,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:57:59,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4728d5045ce94720c25 HTTP/1.1" 200 None 2026-05-10 00:57:59,335 - lava_callback - INFO - Completed processing callback for node 69ffd4728d5045ce94720c25 2026-05-10 00:58:00,295 - lava_callback - INFO - Received callback for node 69ffd4748d5045ce94720c28 INFO: 172.20.0.1:39424 - "POST /node/69ffd4748d5045ce94720c28 HTTP/1.0" 202 Accepted 2026-05-10 00:58:00,303 - lava_callback - INFO - Starting async job submit for node 69ffd4748d5045ce94720c28 2026-05-10 00:58:00,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:00,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4748d5045ce94720c28 HTTP/1.1" 200 None 2026-05-10 00:58:00,351 - lava_callback - DEBUG - Processing node 69ffd4748d5045ce94720c28: ltp-watchqueue 2026-05-10 00:58:00,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:58:00,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:58:00,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ffd4748d5045ce94720c28/log.txt.gz 2026-05-10 00:58:01,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:58:01,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:58:01,414 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ffd4748d5045ce94720c28/lava-logs.yaml 2026-05-10 00:58:01,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:58:01,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:58:01,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ffd4748d5045ce94720c28/lava_callback.json.gz 2026-05-10 00:58:01,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:01,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4748d5045ce94720c28 HTTP/1.1" 200 None 2026-05-10 00:58:01,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:01,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:58:01,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:01,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4748d5045ce94720c28 HTTP/1.1" 200 None 2026-05-10 00:58:01,641 - lava_callback - INFO - Completed processing callback for node 69ffd4748d5045ce94720c28 2026-05-10 00:58:01,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:01,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:58:14,394 - lava_callback - INFO - Received callback for node 69ffd80d8d5045ce947210cd INFO: 172.20.0.1:38586 - "POST /node/69ffd80d8d5045ce947210cd HTTP/1.0" 202 Accepted 2026-05-10 00:58:14,401 - lava_callback - INFO - Starting async job submit for node 69ffd80d8d5045ce947210cd 2026-05-10 00:58:14,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:14,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd80d8d5045ce947210cd HTTP/1.1" 200 None 2026-05-10 00:58:14,424 - lava_callback - DEBUG - Processing node 69ffd80d8d5045ce947210cd: baseline-arm 2026-05-10 00:58:14,429 - lava_callback - WARNING - Failed to upload log 2026-05-10 00:58:14,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:58:14,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:58:14,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd80d8d5045ce947210cd/lava-logs.yaml 2026-05-10 00:58:14,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:58:14,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:58:14,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd80d8d5045ce947210cd/lava_callback.json.gz 2026-05-10 00:58:14,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:14,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd80d8d5045ce947210cd HTTP/1.1" 200 None 2026-05-10 00:58:14,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:14,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:58:14,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:14,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd80d8d5045ce947210cd HTTP/1.1" 200 None 2026-05-10 00:58:14,679 - lava_callback - INFO - Completed processing callback for node 69ffd80d8d5045ce947210cd INFO: 172.20.0.1:38602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42794 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:58:31,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:31,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39890 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:58:37,132 - lava_callback - INFO - Received callback for node 69fd3537197af08e45fc58f8 INFO: 172.20.0.1:39892 - "POST /node/69fd3537197af08e45fc58f8 HTTP/1.0" 202 Accepted 2026-05-10 00:58:37,140 - lava_callback - INFO - Starting async job submit for node 69fd3537197af08e45fc58f8 2026-05-10 00:58:37,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:37,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3537197af08e45fc58f8 HTTP/1.1" 200 None 2026-05-10 00:58:37,158 - lava_callback - DEBUG - Processing node 69fd3537197af08e45fc58f8: baseline-arm-baylibre 2026-05-10 00:58:37,159 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3537197af08e45fc58f8 2026-05-10 00:58:37,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:37,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3537197af08e45fc58f8 HTTP/1.1" 200 None 2026-05-10 00:58:37,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:37,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:58:37,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:58:37,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3537197af08e45fc58f8 HTTP/1.1" 200 None 2026-05-10 00:58:37,211 - lava_callback - ERROR - Error processing callback for node 69fd3537197af08e45fc58f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34592 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:59:12,183 - lava_callback - INFO - Received callback for node 69fd355c197af08e45fc590a INFO: 172.20.0.1:48930 - "POST /node/69fd355c197af08e45fc590a HTTP/1.0" 202 Accepted 2026-05-10 00:59:12,190 - lava_callback - INFO - Starting async job submit for node 69fd355c197af08e45fc590a 2026-05-10 00:59:12,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:12,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd355c197af08e45fc590a HTTP/1.1" 200 None 2026-05-10 00:59:12,206 - lava_callback - DEBUG - Processing node 69fd355c197af08e45fc590a: baseline-arm-clabbe 2026-05-10 00:59:12,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd355c197af08e45fc590a 2026-05-10 00:59:12,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:12,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd355c197af08e45fc590a HTTP/1.1" 200 None 2026-05-10 00:59:12,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:12,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:59:12,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:12,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd355c197af08e45fc590a HTTP/1.1" 200 None 2026-05-10 00:59:12,266 - lava_callback - ERROR - Error processing callback for node 69fd355c197af08e45fc590a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 00:59:13,135 - lava_callback - INFO - Received callback for node 69ffd4298d5045ce94720b2b INFO: 172.20.0.1:48934 - "POST /node/69ffd4298d5045ce94720b2b HTTP/1.0" 202 Accepted 2026-05-10 00:59:13,143 - lava_callback - INFO - Starting async job submit for node 69ffd4298d5045ce94720b2b 2026-05-10 00:59:13,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:13,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4298d5045ce94720b2b HTTP/1.1" 200 None 2026-05-10 00:59:13,250 - lava_callback - DEBUG - Processing node 69ffd4298d5045ce94720b2b: baseline-arm 2026-05-10 00:59:14,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:59:14,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:59:14,158 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4298d5045ce94720b2b/log.txt.gz 2026-05-10 00:59:14,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:59:14,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:59:14,820 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4298d5045ce94720b2b/lava-logs.yaml 2026-05-10 00:59:14,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 00:59:14,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 00:59:14,957 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffd4298d5045ce94720b2b/lava_callback.json.gz DEBUG: Setup failed for 69ffd4298d5045ce94720b2b. Transitting job node result: incomplete -> fail 2026-05-10 00:59:15,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:15,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4298d5045ce94720b2b HTTP/1.1" 200 None 2026-05-10 00:59:15,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:15,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 00:59:15,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:15,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4298d5045ce94720b2b HTTP/1.1" 200 None INFO: 172.20.0.1:48950 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 00:59:15,235 - lava_callback - INFO - Completed processing callback for node 69ffd4298d5045ce94720b2b INFO: 172.20.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42182 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:59:31,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:31,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56632 - "GET / HTTP/1.0" 200 OK 2026-05-10 00:59:52,184 - lava_callback - INFO - Received callback for node 69fd3581197af08e45fc591c INFO: 172.20.0.1:57684 - "POST /node/69fd3581197af08e45fc591c HTTP/1.0" 202 Accepted 2026-05-10 00:59:52,192 - lava_callback - INFO - Starting async job submit for node 69fd3581197af08e45fc591c 2026-05-10 00:59:52,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:52,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3581197af08e45fc591c HTTP/1.1" 200 None 2026-05-10 00:59:52,210 - lava_callback - DEBUG - Processing node 69fd3581197af08e45fc591c: baseline-arm-clabbe 2026-05-10 00:59:52,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3581197af08e45fc591c 2026-05-10 00:59:52,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:52,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3581197af08e45fc591c HTTP/1.1" 200 None 2026-05-10 00:59:52,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:52,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 00:59:52,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 00:59:52,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3581197af08e45fc591c HTTP/1.1" 200 None 2026-05-10 00:59:52,258 - lava_callback - ERROR - Error processing callback for node 69fd3581197af08e45fc591c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33644 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:00:32,267 - lava_callback - INFO - Received callback for node 69fd35a7197af08e45fc592d INFO: 172.20.0.1:35640 - "POST /node/69fd35a7197af08e45fc592d HTTP/1.0" 202 Accepted 2026-05-10 01:00:32,272 - lava_callback - INFO - Starting async job submit for node 69fd35a7197af08e45fc592d 2026-05-10 01:00:32,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:00:32,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd35a7197af08e45fc592d HTTP/1.1" 200 None 2026-05-10 01:00:32,288 - lava_callback - DEBUG - Processing node 69fd35a7197af08e45fc592d: baseline-arm-clabbe 2026-05-10 01:00:32,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd35a7197af08e45fc592d 2026-05-10 01:00:32,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:00:32,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd35a7197af08e45fc592d HTTP/1.1" 200 None 2026-05-10 01:00:32,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:00:32,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 01:00:32,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:00:32,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd35a7197af08e45fc592d HTTP/1.1" 200 None 2026-05-10 01:00:32,344 - lava_callback - ERROR - Error processing callback for node 69fd35a7197af08e45fc592d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41180 - "GET /node/67f9550d9fa3bd5292537344%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51980 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:01:33,518 - lava_callback - INFO - Received callback for node 69ffd44c8d5045ce94720bcb INFO: 172.20.0.1:52026 - "POST /node/69ffd44c8d5045ce94720bcb HTTP/1.0" 202 Accepted 2026-05-10 01:01:33,565 - lava_callback - INFO - Starting async job submit for node 69ffd44c8d5045ce94720bcb 2026-05-10 01:01:33,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:33,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd44c8d5045ce94720bcb HTTP/1.1" 200 None 2026-05-10 01:01:33,607 - lava_callback - DEBUG - Processing node 69ffd44c8d5045ce94720bcb: baseline-arm-pengutronix 2026-05-10 01:01:33,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:01:33,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:01:33,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44c8d5045ce94720bcb/log.txt.gz 2026-05-10 01:01:33,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:01:34,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:01:34,091 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44c8d5045ce94720bcb/lava-logs.yaml 2026-05-10 01:01:34,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:01:34,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:01:34,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffd44c8d5045ce94720bcb/lava_callback.json.gz DEBUG: Setup failed for 69ffd44c8d5045ce94720bcb. Transitting job node result: incomplete -> fail 2026-05-10 01:01:34,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:34,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd44c8d5045ce94720bcb HTTP/1.1" 200 None 2026-05-10 01:01:34,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:34,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 01:01:34,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:34,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd44c8d5045ce94720bcb HTTP/1.1" 200 None 2026-05-10 01:01:34,380 - lava_callback - INFO - Completed processing callback for node 69ffd44c8d5045ce94720bcb INFO: 172.20.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38236 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:01:52,363 - lava_callback - INFO - Received callback for node 69fd35f1197af08e45fc5957 INFO: 172.20.0.1:42918 - "POST /node/69fd35f1197af08e45fc5957 HTTP/1.0" 202 Accepted 2026-05-10 01:01:52,368 - lava_callback - INFO - Starting async job submit for node 69fd35f1197af08e45fc5957 2026-05-10 01:01:52,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:52,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd35f1197af08e45fc5957 HTTP/1.1" 200 None 2026-05-10 01:01:52,384 - lava_callback - DEBUG - Processing node 69fd35f1197af08e45fc5957: baseline-arm-clabbe 2026-05-10 01:01:52,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd35f1197af08e45fc5957 2026-05-10 01:01:52,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:52,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd35f1197af08e45fc5957 HTTP/1.1" 200 None 2026-05-10 01:01:52,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:52,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 01:01:52,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:01:52,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd35f1197af08e45fc5957 HTTP/1.1" 200 None 2026-05-10 01:01:52,430 - lava_callback - ERROR - Error processing callback for node 69fd35f1197af08e45fc5957: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42920 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:02:01,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:02:01,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36420 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:04:18,692 - lava_callback - INFO - Received callback for node 69ffd9828d5045ce94721186 INFO: 172.20.0.1:36430 - "POST /node/69ffd9828d5045ce94721186 HTTP/1.0" 202 Accepted 2026-05-10 01:04:18,700 - lava_callback - INFO - Starting async job submit for node 69ffd9828d5045ce94721186 2026-05-10 01:04:18,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:18,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd9828d5045ce94721186 HTTP/1.1" 200 None 2026-05-10 01:04:18,715 - lava_callback - DEBUG - Processing node 69ffd9828d5045ce94721186: baseline-nfs-arm64 2026-05-10 01:04:18,717 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:04:18,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:04:18,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:04:18,806 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd9828d5045ce94721186/lava-logs.yaml 2026-05-10 01:04:18,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:04:18,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:04:18,899 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd9828d5045ce94721186/lava_callback.json.gz 2026-05-10 01:04:18,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:18,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd9828d5045ce94721186 HTTP/1.1" 200 None 2026-05-10 01:04:18,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:18,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:04:18,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:18,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd9828d5045ce94721186 HTTP/1.1" 200 None 2026-05-10 01:04:18,956 - lava_callback - INFO - Completed processing callback for node 69ffd9828d5045ce94721186 INFO: 172.20.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43400 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:04:31,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:31,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:04:57,579 - lava_callback - INFO - Received callback for node 69fd36b0197af08e45fc5a37 INFO: 172.20.0.1:56622 - "POST /node/69fd36b0197af08e45fc5a37 HTTP/1.0" 202 Accepted 2026-05-10 01:04:57,585 - lava_callback - INFO - Starting async job submit for node 69fd36b0197af08e45fc5a37 2026-05-10 01:04:57,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:57,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b0197af08e45fc5a37 HTTP/1.1" 200 None 2026-05-10 01:04:57,601 - lava_callback - DEBUG - Processing node 69fd36b0197af08e45fc5a37: baseline-arm64-baylibre 2026-05-10 01:04:57,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36b0197af08e45fc5a37 2026-05-10 01:04:57,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:57,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36b0197af08e45fc5a37 HTTP/1.1" 200 None 2026-05-10 01:04:57,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:57,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 01:04:57,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:04:57,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36b0197af08e45fc5a37 HTTP/1.1" 200 None 2026-05-10 01:04:57,657 - lava_callback - ERROR - Error processing callback for node 69fd36b0197af08e45fc5a37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:05:12,471 - lava_callback - INFO - Received callback for node 69fd36c0197af08e45fc5a5a INFO: 172.20.0.1:36482 - "POST /node/69fd36c0197af08e45fc5a5a HTTP/1.0" 202 Accepted 2026-05-10 01:05:12,477 - lava_callback - INFO - Starting async job submit for node 69fd36c0197af08e45fc5a5a 2026-05-10 01:05:12,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:12,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c0197af08e45fc5a5a HTTP/1.1" 200 None 2026-05-10 01:05:12,492 - lava_callback - DEBUG - Processing node 69fd36c0197af08e45fc5a5a: baseline-arm64-clabbe 2026-05-10 01:05:12,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36c0197af08e45fc5a5a 2026-05-10 01:05:12,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:12,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c0197af08e45fc5a5a HTTP/1.1" 200 None 2026-05-10 01:05:12,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:12,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 01:05:12,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:12,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c0197af08e45fc5a5a HTTP/1.1" 200 None 2026-05-10 01:05:12,546 - lava_callback - ERROR - Error processing callback for node 69fd36c0197af08e45fc5a5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:05:13,133 - lava_callback - INFO - Received callback for node 69fd36c2197af08e45fc5a88 INFO: 172.20.0.1:36496 - "POST /node/69fd36c2197af08e45fc5a88 HTTP/1.0" 202 Accepted 2026-05-10 01:05:13,139 - lava_callback - INFO - Starting async job submit for node 69fd36c2197af08e45fc5a88 2026-05-10 01:05:13,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c2197af08e45fc5a88 HTTP/1.1" 200 None 2026-05-10 01:05:13,154 - lava_callback - DEBUG - Processing node 69fd36c2197af08e45fc5a88: baseline-arm64-clabbe 2026-05-10 01:05:13,154 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36c2197af08e45fc5a88 2026-05-10 01:05:13,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c2197af08e45fc5a88 HTTP/1.1" 200 None 2026-05-10 01:05:13,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 01:05:13,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c2197af08e45fc5a88 HTTP/1.1" 200 None 2026-05-10 01:05:13,205 - lava_callback - ERROR - Error processing callback for node 69fd36c2197af08e45fc5a88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:05:13,814 - lava_callback - INFO - Received callback for node 69fd36c3197af08e45fc5a8b INFO: 172.20.0.1:36504 - "POST /node/69fd36c3197af08e45fc5a8b HTTP/1.0" 202 Accepted 2026-05-10 01:05:13,820 - lava_callback - INFO - Starting async job submit for node 69fd36c3197af08e45fc5a8b 2026-05-10 01:05:13,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c3197af08e45fc5a8b HTTP/1.1" 200 None 2026-05-10 01:05:13,836 - lava_callback - DEBUG - Processing node 69fd36c3197af08e45fc5a8b: baseline-arm64-clabbe 2026-05-10 01:05:13,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36c3197af08e45fc5a8b 2026-05-10 01:05:13,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c3197af08e45fc5a8b HTTP/1.1" 200 None 2026-05-10 01:05:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 01:05:13,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:13,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c3197af08e45fc5a8b HTTP/1.1" 200 None 2026-05-10 01:05:13,883 - lava_callback - ERROR - Error processing callback for node 69fd36c3197af08e45fc5a8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:05:14,505 - lava_callback - INFO - Received callback for node 69fd36c4197af08e45fc5a90 INFO: 172.20.0.1:36520 - "POST /node/69fd36c4197af08e45fc5a90 HTTP/1.0" 202 Accepted 2026-05-10 01:05:14,512 - lava_callback - INFO - Starting async job submit for node 69fd36c4197af08e45fc5a90 2026-05-10 01:05:14,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:14,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c4197af08e45fc5a90 HTTP/1.1" 200 None 2026-05-10 01:05:14,546 - lava_callback - DEBUG - Processing node 69fd36c4197af08e45fc5a90: baseline-arm64-clabbe 2026-05-10 01:05:14,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36c4197af08e45fc5a90 2026-05-10 01:05:14,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:14,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c4197af08e45fc5a90 HTTP/1.1" 200 None 2026-05-10 01:05:14,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:14,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 01:05:14,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:14,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c4197af08e45fc5a90 HTTP/1.1" 200 None 2026-05-10 01:05:14,606 - lava_callback - ERROR - Error processing callback for node 69fd36c4197af08e45fc5a90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36534 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 01:05:15,185 - lava_callback - INFO - Received callback for node 69fd36c6197af08e45fc5a99 INFO: 172.20.0.1:36540 - "POST /node/69fd36c6197af08e45fc5a99 HTTP/1.0" 202 Accepted 2026-05-10 01:05:15,191 - lava_callback - INFO - Starting async job submit for node 69fd36c6197af08e45fc5a99 2026-05-10 01:05:15,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c6197af08e45fc5a99 HTTP/1.1" 200 None 2026-05-10 01:05:15,210 - lava_callback - DEBUG - Processing node 69fd36c6197af08e45fc5a99: baseline-arm64-clabbe 2026-05-10 01:05:15,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36c6197af08e45fc5a99 2026-05-10 01:05:15,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c6197af08e45fc5a99 HTTP/1.1" 200 None 2026-05-10 01:05:15,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 01:05:15,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c6197af08e45fc5a99 HTTP/1.1" 200 None 2026-05-10 01:05:15,263 - lava_callback - ERROR - Error processing callback for node 69fd36c6197af08e45fc5a99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:05:15,865 - lava_callback - INFO - Received callback for node 69fd36c5197af08e45fc5a96 INFO: 172.20.0.1:36542 - "POST /node/69fd36c5197af08e45fc5a96 HTTP/1.0" 202 Accepted 2026-05-10 01:05:15,871 - lava_callback - INFO - Starting async job submit for node 69fd36c5197af08e45fc5a96 2026-05-10 01:05:15,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c5197af08e45fc5a96 HTTP/1.1" 200 None 2026-05-10 01:05:15,886 - lava_callback - DEBUG - Processing node 69fd36c5197af08e45fc5a96: baseline-arm64-clabbe 2026-05-10 01:05:15,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36c5197af08e45fc5a96 2026-05-10 01:05:15,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36c5197af08e45fc5a96 HTTP/1.1" 200 None 2026-05-10 01:05:15,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 01:05:15,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:15,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36c5197af08e45fc5a96 HTTP/1.1" 200 None 2026-05-10 01:05:15,933 - lava_callback - ERROR - Error processing callback for node 69fd36c5197af08e45fc5a96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56048 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:05:57,519 - lava_callback - INFO - Received callback for node 69fd36f0197af08e45fc5b1a INFO: 172.20.0.1:56064 - "POST /node/69fd36f0197af08e45fc5b1a HTTP/1.0" 202 Accepted 2026-05-10 01:05:57,524 - lava_callback - INFO - Starting async job submit for node 69fd36f0197af08e45fc5b1a 2026-05-10 01:05:57,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:57,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36f0197af08e45fc5b1a HTTP/1.1" 200 None 2026-05-10 01:05:57,548 - lava_callback - DEBUG - Processing node 69fd36f0197af08e45fc5b1a: baseline-arm-baylibre 2026-05-10 01:05:57,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd36f0197af08e45fc5b1a 2026-05-10 01:05:57,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:57,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd36f0197af08e45fc5b1a HTTP/1.1" 200 None 2026-05-10 01:05:57,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:57,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:05:57,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:05:57,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd36f0197af08e45fc5b1a HTTP/1.1" 200 None 2026-05-10 01:05:57,597 - lava_callback - ERROR - Error processing callback for node 69fd36f0197af08e45fc5b1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53840 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:06:37,636 - lava_callback - INFO - Received callback for node 69fd3715197af08e45fc5b74 INFO: 172.20.0.1:53844 - "POST /node/69fd3715197af08e45fc5b74 HTTP/1.0" 202 Accepted 2026-05-10 01:06:37,642 - lava_callback - INFO - Starting async job submit for node 69fd3715197af08e45fc5b74 2026-05-10 01:06:37,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:06:37,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3715197af08e45fc5b74 HTTP/1.1" 200 None 2026-05-10 01:06:37,660 - lava_callback - DEBUG - Processing node 69fd3715197af08e45fc5b74: baseline-arm-baylibre 2026-05-10 01:06:37,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3715197af08e45fc5b74 2026-05-10 01:06:37,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:06:37,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3715197af08e45fc5b74 HTTP/1.1" 200 None 2026-05-10 01:06:37,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:06:37,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:06:37,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:06:37,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3715197af08e45fc5b74 HTTP/1.1" 200 None 2026-05-10 01:06:37,721 - lava_callback - ERROR - Error processing callback for node 69fd3715197af08e45fc5b74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:07:20,237 - lava_callback - INFO - Received callback for node 69ffda108d5045ce947211de INFO: 172.20.0.1:58230 - "POST /node/69ffda108d5045ce947211de HTTP/1.0" 202 Accepted 2026-05-10 01:07:20,244 - lava_callback - INFO - Starting async job submit for node 69ffda108d5045ce947211de 2026-05-10 01:07:20,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:07:20,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffda108d5045ce947211de HTTP/1.1" 200 None 2026-05-10 01:07:20,309 - lava_callback - DEBUG - Processing node 69ffda108d5045ce947211de: baseline-arm64 2026-05-10 01:07:20,476 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:07:20,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:07:20,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:07:20,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffda108d5045ce947211de/lava-logs.yaml 2026-05-10 01:07:20,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:07:20,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:07:20,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffda108d5045ce947211de/lava_callback.json.gz 2026-05-10 01:07:20,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:07:20,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffda108d5045ce947211de HTTP/1.1" 200 None 2026-05-10 01:07:20,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:07:20,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:07:20,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:07:20,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffda108d5045ce947211de HTTP/1.1" 200 None 2026-05-10 01:07:20,993 - lava_callback - INFO - Completed processing callback for node 69ffda108d5045ce947211de INFO: 172.20.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58246 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:07:31,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:07:31,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46548 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:08:37,762 - lava_callback - INFO - Received callback for node 69fd3786197af08e45fc5be7 INFO: 172.20.0.1:46554 - "POST /node/69fd3786197af08e45fc5be7 HTTP/1.0" 202 Accepted 2026-05-10 01:08:37,771 - lava_callback - INFO - Starting async job submit for node 69fd3786197af08e45fc5be7 2026-05-10 01:08:37,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:37,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3786197af08e45fc5be7 HTTP/1.1" 200 None 2026-05-10 01:08:37,803 - lava_callback - DEBUG - Processing node 69fd3786197af08e45fc5be7: baseline-arm-baylibre 2026-05-10 01:08:37,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3786197af08e45fc5be7 2026-05-10 01:08:37,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:37,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3786197af08e45fc5be7 HTTP/1.1" 200 None 2026-05-10 01:08:37,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:37,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:08:37,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:37,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3786197af08e45fc5be7 HTTP/1.1" 200 None 2026-05-10 01:08:37,912 - lava_callback - ERROR - Error processing callback for node 69fd3786197af08e45fc5be7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:08:46,909 - lava_callback - INFO - Received callback for node 69ffda5a8d5045ce94721202 INFO: 172.20.0.1:32932 - "POST /node/69ffda5a8d5045ce94721202 HTTP/1.0" 202 Accepted 2026-05-10 01:08:46,917 - lava_callback - INFO - Starting async job submit for node 69ffda5a8d5045ce94721202 2026-05-10 01:08:46,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:46,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffda5a8d5045ce94721202 HTTP/1.1" 200 None 2026-05-10 01:08:46,966 - lava_callback - DEBUG - Processing node 69ffda5a8d5045ce94721202: baseline-arm64 2026-05-10 01:08:47,204 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:08:47,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:08:47,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:08:47,513 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffda5a8d5045ce94721202/lava-logs.yaml 2026-05-10 01:08:47,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:08:47,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:08:47,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffda5a8d5045ce94721202/lava_callback.json.gz 2026-05-10 01:08:47,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:47,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffda5a8d5045ce94721202 HTTP/1.1" 200 None 2026-05-10 01:08:47,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:47,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:08:47,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:08:47,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffda5a8d5045ce94721202 HTTP/1.1" 200 None 2026-05-10 01:08:47,810 - lava_callback - INFO - Completed processing callback for node 69ffda5a8d5045ce94721202 INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:09:01,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:01,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35672 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:09:23,432 - lava_callback - INFO - Received callback for node 69ffd5d68d5045ce94720dc7 INFO: 172.20.0.1:35680 - "POST /node/69ffd5d68d5045ce94720dc7 HTTP/1.0" 202 Accepted 2026-05-10 01:09:23,441 - lava_callback - INFO - Starting async job submit for node 69ffd5d68d5045ce94720dc7 2026-05-10 01:09:23,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:23,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d68d5045ce94720dc7 HTTP/1.1" 200 None 2026-05-10 01:09:23,521 - lava_callback - DEBUG - Processing node 69ffd5d68d5045ce94720dc7: baseline-nfs-arm64 2026-05-10 01:09:24,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:09:25,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:09:25,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d68d5045ce94720dc7/log.txt.gz 2026-05-10 01:09:25,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:09:25,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:09:25,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d68d5045ce94720dc7/lava-logs.yaml 2026-05-10 01:09:25,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:09:26,091 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:09:26,092 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffd5d68d5045ce94720dc7/lava_callback.json.gz DEBUG: Setup failed for 69ffd5d68d5045ce94720dc7. Transitting job node result: incomplete -> fail 2026-05-10 01:09:26,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:26,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5d68d5045ce94720dc7 HTTP/1.1" 200 None 2026-05-10 01:09:26,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:26,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:09:26,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:26,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5d68d5045ce94720dc7 HTTP/1.1" 200 None 2026-05-10 01:09:26,328 - lava_callback - INFO - Completed processing callback for node 69ffd5d68d5045ce94720dc7 INFO: 172.20.0.1:35696 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:09:31,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:31,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:09:38,078 - lava_callback - INFO - Received callback for node 69ffd5f28d5045ce94720e37 INFO: 172.20.0.1:41500 - "POST /node/69ffd5f28d5045ce94720e37 HTTP/1.0" 202 Accepted 2026-05-10 01:09:38,126 - lava_callback - INFO - Starting async job submit for node 69ffd5f28d5045ce94720e37 2026-05-10 01:09:38,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:38,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5f28d5045ce94720e37 HTTP/1.1" 200 None 2026-05-10 01:09:38,201 - lava_callback - DEBUG - Processing node 69ffd5f28d5045ce94720e37: baseline-arm64-broonie 2026-05-10 01:09:38,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:09:38,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:09:38,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5f28d5045ce94720e37/log.txt.gz 2026-05-10 01:09:38,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:09:38,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:09:38,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5f28d5045ce94720e37/lava-logs.yaml 2026-05-10 01:09:38,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:09:38,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:09:38,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffd5f28d5045ce94720e37/lava_callback.json.gz 2026-05-10 01:09:38,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:38,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd5f28d5045ce94720e37 HTTP/1.1" 200 None 2026-05-10 01:09:38,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:38,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:09:38,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:38,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd5f28d5045ce94720e37 HTTP/1.1" 200 None 2026-05-10 01:09:38,924 - lava_callback - INFO - Completed processing callback for node 69ffd5f28d5045ce94720e37 INFO: 172.20.0.1:60470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60184 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:09:57,846 - lava_callback - INFO - Received callback for node 69fd37d2197af08e45fc5c25 INFO: 172.20.0.1:60186 - "POST /node/69fd37d2197af08e45fc5c25 HTTP/1.0" 202 Accepted 2026-05-10 01:09:57,852 - lava_callback - INFO - Starting async job submit for node 69fd37d2197af08e45fc5c25 2026-05-10 01:09:57,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:57,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd37d2197af08e45fc5c25 HTTP/1.1" 200 None 2026-05-10 01:09:57,872 - lava_callback - DEBUG - Processing node 69fd37d2197af08e45fc5c25: baseline-arm-baylibre 2026-05-10 01:09:57,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd37d2197af08e45fc5c25 2026-05-10 01:09:57,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:57,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd37d2197af08e45fc5c25 HTTP/1.1" 200 None 2026-05-10 01:09:57,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:57,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:09:57,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:09:57,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd37d2197af08e45fc5c25 HTTP/1.1" 200 None 2026-05-10 01:09:57,919 - lava_callback - ERROR - Error processing callback for node 69fd37d2197af08e45fc5c25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:10:01,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:10:01,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60532 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:10:36,910 - lava_callback - INFO - Received callback for node 69ffdac18d5045ce94721247 INFO: 172.20.0.1:60534 - "POST /node/69ffdac18d5045ce94721247 HTTP/1.0" 202 Accepted 2026-05-10 01:10:36,918 - lava_callback - INFO - Starting async job submit for node 69ffdac18d5045ce94721247 2026-05-10 01:10:36,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:10:36,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdac18d5045ce94721247 HTTP/1.1" 200 None 2026-05-10 01:10:36,965 - lava_callback - DEBUG - Processing node 69ffdac18d5045ce94721247: baseline-arm64-foundriesio 2026-05-10 01:10:37,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:10:37,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:10:37,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffdac18d5045ce94721247/log.txt.gz 2026-05-10 01:10:37,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:10:38,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:10:38,020 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffdac18d5045ce94721247/lava-logs.yaml 2026-05-10 01:10:38,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:10:38,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:10:38,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ffdac18d5045ce94721247/lava_callback.json.gz 2026-05-10 01:10:38,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:10:38,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdac18d5045ce94721247 HTTP/1.1" 200 None 2026-05-10 01:10:38,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:10:38,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:10:38,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:10:38,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffdac18d5045ce94721247 HTTP/1.1" 200 None 2026-05-10 01:10:38,280 - lava_callback - INFO - Completed processing callback for node 69ffdac18d5045ce94721247 INFO: 172.20.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56106 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:11:01,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:11:01,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60996 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:12:13,069 - lava_callback - INFO - Received callback for node 69fd3869197af08e45fc5c7a INFO: 172.20.0.1:60430 - "POST /node/69fd3869197af08e45fc5c7a HTTP/1.0" 202 Accepted 2026-05-10 01:12:13,075 - lava_callback - INFO - Starting async job submit for node 69fd3869197af08e45fc5c7a 2026-05-10 01:12:13,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:12:13,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3869197af08e45fc5c7a HTTP/1.1" 200 None 2026-05-10 01:12:13,091 - lava_callback - DEBUG - Processing node 69fd3869197af08e45fc5c7a: baseline-arm-clabbe 2026-05-10 01:12:13,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3869197af08e45fc5c7a 2026-05-10 01:12:13,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:12:13,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3869197af08e45fc5c7a HTTP/1.1" 200 None 2026-05-10 01:12:13,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:12:13,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:12:13,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:12:13,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3869197af08e45fc5c7a HTTP/1.1" 200 None 2026-05-10 01:12:13,138 - lava_callback - ERROR - Error processing callback for node 69fd3869197af08e45fc5c7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56408 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:13:32,816 - lava_callback - INFO - Received callback for node 69fd38b3197af08e45fc5c9d INFO: 172.20.0.1:35090 - "POST /node/69fd38b3197af08e45fc5c9d HTTP/1.0" 202 Accepted 2026-05-10 01:13:32,821 - lava_callback - INFO - Starting async job submit for node 69fd38b3197af08e45fc5c9d 2026-05-10 01:13:32,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:13:32,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd38b3197af08e45fc5c9d HTTP/1.1" 200 None 2026-05-10 01:13:32,838 - lava_callback - DEBUG - Processing node 69fd38b3197af08e45fc5c9d: baseline-arm-clabbe 2026-05-10 01:13:32,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd38b3197af08e45fc5c9d 2026-05-10 01:13:32,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:13:32,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd38b3197af08e45fc5c9d HTTP/1.1" 200 None 2026-05-10 01:13:32,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:13:32,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:13:32,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:13:32,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd38b3197af08e45fc5c9d HTTP/1.1" 200 None 2026-05-10 01:13:32,883 - lava_callback - ERROR - Error processing callback for node 69fd38b3197af08e45fc5c9d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33156 - "GET /node/698694da2de8e2dea3666215%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46262 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:15:21,427 - lava_callback - INFO - Received callback for node 69ffd4658d5045ce94720c0a INFO: 172.20.0.1:43494 - "POST /node/69ffd4658d5045ce94720c0a HTTP/1.0" 202 Accepted 2026-05-10 01:15:21,434 - lava_callback - INFO - Starting async job submit for node 69ffd4658d5045ce94720c0a 2026-05-10 01:15:21,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:15:21,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4658d5045ce94720c0a HTTP/1.1" 200 None 2026-05-10 01:15:21,485 - lava_callback - DEBUG - Processing node 69ffd4658d5045ce94720c0a: ltp-fs_bind 2026-05-10 01:15:21,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:15:21,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:15:21,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ffd4658d5045ce94720c0a/log.txt.gz 2026-05-10 01:15:22,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:15:22,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:15:22,351 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ffd4658d5045ce94720c0a/lava-logs.yaml 2026-05-10 01:15:22,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:15:22,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:15:22,502 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ffd4658d5045ce94720c0a/lava_callback.json.gz 2026-05-10 01:15:22,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:22,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffd4658d5045ce94720c0a HTTP/1.1" 200 None 2026-05-10 01:15:22,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:22,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 01:15:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:22,620 - lava_callback - INFO - Received callback for node 69ffdc168d5045ce947212f0 INFO: 172.20.0.1:43508 - "POST /node/69ffdc168d5045ce947212f0 HTTP/1.0" 202 Accepted 2026-05-10 01:15:22,631 - lava_callback - INFO - Starting async job submit for node 69ffdc168d5045ce947212f0 2026-05-10 01:15:22,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:22,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffd4658d5045ce94720c0a HTTP/1.1" 200 None 2026-05-10 01:15:22,721 - lava_callback - INFO - Completed processing callback for node 69ffd4658d5045ce94720c0a 2026-05-10 01:15:22,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdc168d5045ce947212f0 HTTP/1.1" 200 None 2026-05-10 01:15:22,727 - lava_callback - DEBUG - Processing node 69ffdc168d5045ce947212f0: baseline-arm 2026-05-10 01:15:22,746 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:15:22,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:15:22,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:15:22,860 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffdc168d5045ce947212f0/lava-logs.yaml 2026-05-10 01:15:22,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:15:22,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:15:22,970 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffdc168d5045ce947212f0/lava_callback.json.gz 2026-05-10 01:15:22,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:22,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdc168d5045ce947212f0 HTTP/1.1" 200 None 2026-05-10 01:15:22,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:23,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 01:15:23,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:23,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffdc168d5045ce947212f0 HTTP/1.1" 200 None 2026-05-10 01:15:23,029 - lava_callback - INFO - Completed processing callback for node 69ffdc168d5045ce947212f0 INFO: 172.20.0.1:43524 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:15:31,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:15:32,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51850 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46786 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:19:38,371 - lava_callback - INFO - Received callback for node 69ffdb658d5045ce947212a2 INFO: 172.20.0.1:46800 - "POST /node/69ffdb658d5045ce947212a2 HTTP/1.0" 202 Accepted 2026-05-10 01:19:38,378 - lava_callback - INFO - Starting async job submit for node 69ffdb658d5045ce947212a2 2026-05-10 01:19:38,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:19:38,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdb658d5045ce947212a2 HTTP/1.1" 200 None 2026-05-10 01:19:38,448 - lava_callback - DEBUG - Processing node 69ffdb658d5045ce947212a2: baseline-arm64 2026-05-10 01:19:38,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:19:38,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:19:38,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffdb658d5045ce947212a2/log.txt.gz 2026-05-10 01:19:39,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:19:39,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:19:39,450 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffdb658d5045ce947212a2/lava-logs.yaml 2026-05-10 01:19:39,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:19:39,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:19:39,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffdb658d5045ce947212a2/lava_callback.json.gz DEBUG: Setup failed for 69ffdb658d5045ce947212a2. Transitting job node result: incomplete -> fail 2026-05-10 01:19:39,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:19:39,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdb658d5045ce947212a2 HTTP/1.1" 200 None 2026-05-10 01:19:39,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:19:39,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:19:39,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:19:39,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffdb658d5045ce947212a2 HTTP/1.1" 200 None 2026-05-10 01:19:39,849 - lava_callback - INFO - Completed processing callback for node 69ffdb658d5045ce947212a2 INFO: 172.20.0.1:38724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49966 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:20:02,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:20:02,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:20:33,042 - lava_callback - INFO - Received callback for node 69fd3a4b197af08e45fc5d7a INFO: 172.20.0.1:48470 - "POST /node/69fd3a4b197af08e45fc5d7a HTTP/1.0" 202 Accepted 2026-05-10 01:20:33,048 - lava_callback - INFO - Starting async job submit for node 69fd3a4b197af08e45fc5d7a 2026-05-10 01:20:33,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:20:33,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3a4b197af08e45fc5d7a HTTP/1.1" 200 None 2026-05-10 01:20:33,064 - lava_callback - DEBUG - Processing node 69fd3a4b197af08e45fc5d7a: baseline-arm-clabbe 2026-05-10 01:20:33,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3a4b197af08e45fc5d7a 2026-05-10 01:20:33,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:20:33,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3a4b197af08e45fc5d7a HTTP/1.1" 200 None 2026-05-10 01:20:33,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:20:33,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:20:33,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:20:33,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3a4b197af08e45fc5d7a HTTP/1.1" 200 None 2026-05-10 01:20:33,110 - lava_callback - ERROR - Error processing callback for node 69fd3a4b197af08e45fc5d7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:23:32,520 - lava_callback - INFO - Received callback for node 69ffddfc8d5045ce947213ad INFO: 172.20.0.1:46372 - "POST /node/69ffddfc8d5045ce947213ad HTTP/1.0" 202 Accepted 2026-05-10 01:23:32,527 - lava_callback - INFO - Starting async job submit for node 69ffddfc8d5045ce947213ad 2026-05-10 01:23:32,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:32,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffddfc8d5045ce947213ad HTTP/1.1" 200 None 2026-05-10 01:23:32,543 - lava_callback - DEBUG - Processing node 69ffddfc8d5045ce947213ad: baseline-nfs-arm64 2026-05-10 01:23:32,544 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:23:32,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:23:32,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:23:32,656 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffddfc8d5045ce947213ad/lava-logs.yaml 2026-05-10 01:23:32,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:23:32,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:23:32,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffddfc8d5045ce947213ad/lava_callback.json.gz 2026-05-10 01:23:32,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:32,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffddfc8d5045ce947213ad HTTP/1.1" 200 None 2026-05-10 01:23:32,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:32,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:23:32,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:32,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffddfc8d5045ce947213ad HTTP/1.1" 200 None 2026-05-10 01:23:32,796 - lava_callback - INFO - Completed processing callback for node 69ffddfc8d5045ce947213ad 2026-05-10 01:23:33,186 - lava_callback - INFO - Received callback for node 69fd3b09197af08e45fc5de3 INFO: 172.20.0.1:46388 - "POST /node/69fd3b09197af08e45fc5de3 HTTP/1.0" 202 Accepted 2026-05-10 01:23:33,192 - lava_callback - INFO - Starting async job submit for node 69fd3b09197af08e45fc5de3 2026-05-10 01:23:33,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:33,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3b09197af08e45fc5de3 HTTP/1.1" 200 None 2026-05-10 01:23:33,207 - lava_callback - DEBUG - Processing node 69fd3b09197af08e45fc5de3: baseline-arm-clabbe 2026-05-10 01:23:33,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3b09197af08e45fc5de3 2026-05-10 01:23:33,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:33,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3b09197af08e45fc5de3 HTTP/1.1" 200 None 2026-05-10 01:23:33,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:33,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:23:33,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:23:33,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3b09197af08e45fc5de3 HTTP/1.1" 200 None 2026-05-10 01:23:33,259 - lava_callback - ERROR - Error processing callback for node 69fd3b09197af08e45fc5de3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54702 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:24:02,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:24:02,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53544 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:24:13,148 - lava_callback - INFO - Received callback for node 69fd3b2e197af08e45fc5dfc INFO: 172.20.0.1:51524 - "POST /node/69fd3b2e197af08e45fc5dfc HTTP/1.0" 202 Accepted 2026-05-10 01:24:13,154 - lava_callback - INFO - Starting async job submit for node 69fd3b2e197af08e45fc5dfc 2026-05-10 01:24:13,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:24:13,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3b2e197af08e45fc5dfc HTTP/1.1" 200 None 2026-05-10 01:24:13,177 - lava_callback - DEBUG - Processing node 69fd3b2e197af08e45fc5dfc: baseline-arm-clabbe 2026-05-10 01:24:13,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3b2e197af08e45fc5dfc 2026-05-10 01:24:13,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:24:13,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3b2e197af08e45fc5dfc HTTP/1.1" 200 None 2026-05-10 01:24:13,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:24:13,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5445fed4ed40b0223daff HTTP/1.1" 200 None 2026-05-10 01:24:13,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:24:13,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3b2e197af08e45fc5dfc HTTP/1.1" 200 None 2026-05-10 01:24:13,241 - lava_callback - ERROR - Error processing callback for node 69fd3b2e197af08e45fc5dfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:26:18,938 - lava_callback - INFO - Received callback for node 69fd3ba8197af08e45fc5e3a INFO: 172.20.0.1:51442 - "POST /node/69fd3ba8197af08e45fc5e3a HTTP/1.0" 202 Accepted 2026-05-10 01:26:18,945 - lava_callback - INFO - Starting async job submit for node 69fd3ba8197af08e45fc5e3a 2026-05-10 01:26:18,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:18,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ba8197af08e45fc5e3a HTTP/1.1" 200 None 2026-05-10 01:26:18,960 - lava_callback - DEBUG - Processing node 69fd3ba8197af08e45fc5e3a: baseline-arm64-baylibre 2026-05-10 01:26:18,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3ba8197af08e45fc5e3a 2026-05-10 01:26:18,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:18,968 - lava_callback - INFO - Received callback for node 69ffdaa58d5045ce94721233 INFO: 172.20.0.1:51454 - "POST /node/69ffdaa58d5045ce94721233 HTTP/1.0" 202 Accepted 2026-05-10 01:26:18,976 - lava_callback - INFO - Starting async job submit for node 69ffdaa58d5045ce94721233 2026-05-10 01:26:19,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ba8197af08e45fc5e3a HTTP/1.1" 200 None 2026-05-10 01:26:19,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:19,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:19,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:26:19,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdaa58d5045ce94721233 HTTP/1.1" 200 None 2026-05-10 01:26:19,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:19,079 - lava_callback - DEBUG - Processing node 69ffdaa58d5045ce94721233: ltp-smoke 2026-05-10 01:26:19,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3ba8197af08e45fc5e3a HTTP/1.1" 200 None 2026-05-10 01:26:19,187 - lava_callback - ERROR - Error processing callback for node 69fd3ba8197af08e45fc5e3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:26:19,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:26:19,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:26:19,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffdaa58d5045ce94721233/log.txt.gz 2026-05-10 01:26:19,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:26:20,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:26:20,174 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffdaa58d5045ce94721233/lava-logs.yaml 2026-05-10 01:26:20,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:26:20,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:26:20,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffdaa58d5045ce94721233/lava_callback.json.gz 2026-05-10 01:26:20,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:20,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdaa58d5045ce94721233 HTTP/1.1" 200 None 2026-05-10 01:26:20,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:20,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce858d5045ce9471e366 HTTP/1.1" 200 None 2026-05-10 01:26:20,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:20,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffdaa58d5045ce94721233 HTTP/1.1" 200 None 2026-05-10 01:26:20,618 - lava_callback - INFO - Completed processing callback for node 69ffdaa58d5045ce94721233 INFO: 172.20.0.1:55266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55274 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:26:32,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:26:32,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:27:38,707 - lava_callback - INFO - Received callback for node 69fd3bf5197af08e45fc5e5d INFO: 172.20.0.1:39436 - "POST /node/69fd3bf5197af08e45fc5e5d HTTP/1.0" 202 Accepted 2026-05-10 01:27:38,716 - lava_callback - INFO - Starting async job submit for node 69fd3bf5197af08e45fc5e5d 2026-05-10 01:27:38,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:27:38,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3bf5197af08e45fc5e5d HTTP/1.1" 200 None 2026-05-10 01:27:38,732 - lava_callback - DEBUG - Processing node 69fd3bf5197af08e45fc5e5d: baseline-arm64-baylibre 2026-05-10 01:27:38,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3bf5197af08e45fc5e5d 2026-05-10 01:27:38,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:27:38,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3bf5197af08e45fc5e5d HTTP/1.1" 200 None 2026-05-10 01:27:38,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:27:38,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:27:38,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:27:38,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3bf5197af08e45fc5e5d HTTP/1.1" 200 None 2026-05-10 01:27:38,786 - lava_callback - ERROR - Error processing callback for node 69fd3bf5197af08e45fc5e5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47782 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:28:38,708 - lava_callback - INFO - Received callback for node 69fd3c41197af08e45fc5e80 INFO: 172.20.0.1:47794 - "POST /node/69fd3c41197af08e45fc5e80 HTTP/1.0" 202 Accepted 2026-05-10 01:28:38,714 - lava_callback - INFO - Starting async job submit for node 69fd3c41197af08e45fc5e80 2026-05-10 01:28:38,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:28:38,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3c41197af08e45fc5e80 HTTP/1.1" 200 None 2026-05-10 01:28:38,729 - lava_callback - DEBUG - Processing node 69fd3c41197af08e45fc5e80: baseline-arm64-baylibre 2026-05-10 01:28:38,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3c41197af08e45fc5e80 2026-05-10 01:28:38,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:28:38,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3c41197af08e45fc5e80 HTTP/1.1" 200 None 2026-05-10 01:28:38,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:28:38,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:28:38,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:28:38,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3c41197af08e45fc5e80 HTTP/1.1" 200 None 2026-05-10 01:28:38,782 - lava_callback - ERROR - Error processing callback for node 69fd3c41197af08e45fc5e80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44762 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:29:53,431 - lava_callback - INFO - Received callback for node 69fd3c8c197af08e45fc5ea6 INFO: 172.20.0.1:47698 - "POST /node/69fd3c8c197af08e45fc5ea6 HTTP/1.0" 202 Accepted 2026-05-10 01:29:53,436 - lava_callback - INFO - Starting async job submit for node 69fd3c8c197af08e45fc5ea6 2026-05-10 01:29:53,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:29:53,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3c8c197af08e45fc5ea6 HTTP/1.1" 200 None 2026-05-10 01:29:53,452 - lava_callback - DEBUG - Processing node 69fd3c8c197af08e45fc5ea6: baseline-arm-clabbe 2026-05-10 01:29:53,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3c8c197af08e45fc5ea6 2026-05-10 01:29:53,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:29:53,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3c8c197af08e45fc5ea6 HTTP/1.1" 200 None 2026-05-10 01:29:53,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:29:53,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 01:29:53,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:29:53,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3c8c197af08e45fc5ea6 HTTP/1.1" 200 None 2026-05-10 01:29:53,499 - lava_callback - ERROR - Error processing callback for node 69fd3c8c197af08e45fc5ea6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55670 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:30:38,845 - lava_callback - INFO - Received callback for node 69fd3cb8197af08e45fc5eb8 INFO: 172.20.0.1:55680 - "POST /node/69fd3cb8197af08e45fc5eb8 HTTP/1.0" 202 Accepted 2026-05-10 01:30:38,852 - lava_callback - INFO - Starting async job submit for node 69fd3cb8197af08e45fc5eb8 2026-05-10 01:30:38,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:30:38,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3cb8197af08e45fc5eb8 HTTP/1.1" 200 None 2026-05-10 01:30:38,871 - lava_callback - DEBUG - Processing node 69fd3cb8197af08e45fc5eb8: baseline-arm64-baylibre 2026-05-10 01:30:38,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3cb8197af08e45fc5eb8 2026-05-10 01:30:38,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:30:38,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3cb8197af08e45fc5eb8 HTTP/1.1" 200 None 2026-05-10 01:30:38,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:30:38,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:30:38,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:30:38,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3cb8197af08e45fc5eb8 HTTP/1.1" 200 None 2026-05-10 01:30:38,925 - lava_callback - ERROR - Error processing callback for node 69fd3cb8197af08e45fc5eb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58038 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:31:58,976 - lava_callback - INFO - Received callback for node 69fd3d04197af08e45fc5eda INFO: 172.20.0.1:58044 - "POST /node/69fd3d04197af08e45fc5eda HTTP/1.0" 202 Accepted 2026-05-10 01:31:58,982 - lava_callback - INFO - Starting async job submit for node 69fd3d04197af08e45fc5eda 2026-05-10 01:31:58,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:31:58,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3d04197af08e45fc5eda HTTP/1.1" 200 None 2026-05-10 01:31:58,997 - lava_callback - DEBUG - Processing node 69fd3d04197af08e45fc5eda: baseline-arm64-baylibre 2026-05-10 01:31:58,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3d04197af08e45fc5eda 2026-05-10 01:31:58,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:31:59,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3d04197af08e45fc5eda HTTP/1.1" 200 None 2026-05-10 01:31:59,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:31:59,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:31:59,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:31:59,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3d04197af08e45fc5eda HTTP/1.1" 200 None 2026-05-10 01:31:59,054 - lava_callback - ERROR - Error processing callback for node 69fd3d04197af08e45fc5eda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41382 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:33:19,042 - lava_callback - INFO - Received callback for node 69fd3d50197af08e45fc5f00 INFO: 172.20.0.1:41386 - "POST /node/69fd3d50197af08e45fc5f00 HTTP/1.0" 202 Accepted 2026-05-10 01:33:19,047 - lava_callback - INFO - Starting async job submit for node 69fd3d50197af08e45fc5f00 2026-05-10 01:33:19,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:19,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3d50197af08e45fc5f00 HTTP/1.1" 200 None 2026-05-10 01:33:19,063 - lava_callback - DEBUG - Processing node 69fd3d50197af08e45fc5f00: baseline-arm64-baylibre 2026-05-10 01:33:19,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3d50197af08e45fc5f00 2026-05-10 01:33:19,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:19,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3d50197af08e45fc5f00 HTTP/1.1" 200 None 2026-05-10 01:33:19,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:19,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:33:19,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:19,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3d50197af08e45fc5f00 HTTP/1.1" 200 None 2026-05-10 01:33:19,109 - lava_callback - ERROR - Error processing callback for node 69fd3d50197af08e45fc5f00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47712 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:33:41,300 - lava_callback - INFO - Received callback for node 69ffe04d8d5045ce947214ff INFO: 172.20.0.1:51570 - "POST /node/69ffe04d8d5045ce947214ff HTTP/1.0" 202 Accepted 2026-05-10 01:33:41,311 - lava_callback - INFO - Starting async job submit for node 69ffe04d8d5045ce947214ff 2026-05-10 01:33:41,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:41,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe04d8d5045ce947214ff HTTP/1.1" 200 None 2026-05-10 01:33:41,357 - lava_callback - DEBUG - Processing node 69ffe04d8d5045ce947214ff: baseline-arm64 2026-05-10 01:33:41,545 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:33:41,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:33:41,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:33:41,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe04d8d5045ce947214ff/lava-logs.yaml 2026-05-10 01:33:41,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:33:41,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:33:41,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe04d8d5045ce947214ff/lava_callback.json.gz 2026-05-10 01:33:41,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:41,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe04d8d5045ce947214ff HTTP/1.1" 200 None 2026-05-10 01:33:41,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:41,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:33:41,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:33:41,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe04d8d5045ce947214ff HTTP/1.1" 200 None 2026-05-10 01:33:42,041 - lava_callback - INFO - Completed processing callback for node 69ffe04d8d5045ce947214ff INFO: 172.20.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58608 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:34:02,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:34:02,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:34:33,625 - lava_callback - INFO - Received callback for node 69fd3da0197af08e45fc5f20 INFO: 172.20.0.1:48246 - "POST /node/69fd3da0197af08e45fc5f20 HTTP/1.0" 202 Accepted 2026-05-10 01:34:33,631 - lava_callback - INFO - Starting async job submit for node 69fd3da0197af08e45fc5f20 2026-05-10 01:34:33,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:34:33,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3da0197af08e45fc5f20 HTTP/1.1" 200 None 2026-05-10 01:34:33,645 - lava_callback - DEBUG - Processing node 69fd3da0197af08e45fc5f20: baseline-arm64-clabbe 2026-05-10 01:34:33,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3da0197af08e45fc5f20 2026-05-10 01:34:33,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:34:33,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3da0197af08e45fc5f20 HTTP/1.1" 200 None 2026-05-10 01:34:33,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:34:33,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:34:33,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:34:33,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3da0197af08e45fc5f20 HTTP/1.1" 200 None 2026-05-10 01:34:33,696 - lava_callback - ERROR - Error processing callback for node 69fd3da0197af08e45fc5f20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:35:02,135 - lava_callback - INFO - Received callback for node 69ffe09a8d5045ce9472152b INFO: 172.20.0.1:44134 - "POST /node/69ffe09a8d5045ce9472152b HTTP/1.0" 202 Accepted 2026-05-10 01:35:02,146 - lava_callback - INFO - Starting async job submit for node 69ffe09a8d5045ce9472152b 2026-05-10 01:35:02,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:02,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe09a8d5045ce9472152b HTTP/1.1" 200 None 2026-05-10 01:35:02,203 - lava_callback - DEBUG - Processing node 69ffe09a8d5045ce9472152b: baseline-arm64 2026-05-10 01:35:02,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:35:02,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:35:02,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe09a8d5045ce9472152b/log.txt.gz 2026-05-10 01:35:02,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:35:02,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:35:02,768 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe09a8d5045ce9472152b/lava-logs.yaml 2026-05-10 01:35:02,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:35:02,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:35:02,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe09a8d5045ce9472152b/lava_callback.json.gz 2026-05-10 01:35:02,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:02,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe09a8d5045ce9472152b HTTP/1.1" 200 None 2026-05-10 01:35:02,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:02,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:35:02,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:02,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe09a8d5045ce9472152b HTTP/1.1" 200 None 2026-05-10 01:35:03,042 - lava_callback - INFO - Completed processing callback for node 69ffe09a8d5045ce9472152b INFO: 172.20.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40048 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:35:32,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:32,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59236 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:35:53,666 - lava_callback - INFO - Received callback for node 69fd3ded197af08e45fc5f4f INFO: 172.20.0.1:34218 - "POST /node/69fd3ded197af08e45fc5f4f HTTP/1.0" 202 Accepted 2026-05-10 01:35:53,672 - lava_callback - INFO - Starting async job submit for node 69fd3ded197af08e45fc5f4f 2026-05-10 01:35:53,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:53,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ded197af08e45fc5f4f HTTP/1.1" 200 None 2026-05-10 01:35:53,687 - lava_callback - DEBUG - Processing node 69fd3ded197af08e45fc5f4f: baseline-arm64-clabbe 2026-05-10 01:35:53,687 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3ded197af08e45fc5f4f 2026-05-10 01:35:53,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:53,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ded197af08e45fc5f4f HTTP/1.1" 200 None 2026-05-10 01:35:53,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:53,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:35:53,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:53,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3ded197af08e45fc5f4f HTTP/1.1" 200 None 2026-05-10 01:35:53,738 - lava_callback - ERROR - Error processing callback for node 69fd3ded197af08e45fc5f4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:35:54,645 - lava_callback - INFO - Received callback for node 69ffdccb8d5045ce94721333 INFO: 172.20.0.1:34222 - "POST /node/69ffdccb8d5045ce94721333 HTTP/1.0" 202 Accepted 2026-05-10 01:35:54,651 - lava_callback - INFO - Starting async job submit for node 69ffdccb8d5045ce94721333 2026-05-10 01:35:54,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:54,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdccb8d5045ce94721333 HTTP/1.1" 200 None 2026-05-10 01:35:54,737 - lava_callback - DEBUG - Processing node 69ffdccb8d5045ce94721333: baseline-arm 2026-05-10 01:35:55,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:35:55,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:35:55,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffdccb8d5045ce94721333/log.txt.gz 2026-05-10 01:35:55,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:35:56,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:35:56,078 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffdccb8d5045ce94721333/lava-logs.yaml 2026-05-10 01:35:56,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:35:56,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:35:56,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffdccb8d5045ce94721333/lava_callback.json.gz DEBUG: Setup failed for 69ffdccb8d5045ce94721333. Transitting job node result: incomplete -> fail 2026-05-10 01:35:56,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:56,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdccb8d5045ce94721333 HTTP/1.1" 200 None 2026-05-10 01:35:56,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:56,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 01:35:56,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:35:56,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffdccb8d5045ce94721333 HTTP/1.1" 200 None 2026-05-10 01:35:56,467 - lava_callback - INFO - Completed processing callback for node 69ffdccb8d5045ce94721333 INFO: 172.20.0.1:34238 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:36:02,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:36:02,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:37:13,739 - lava_callback - INFO - Received callback for node 69fd3e39197af08e45fc5f68 INFO: 172.20.0.1:50656 - "POST /node/69fd3e39197af08e45fc5f68 HTTP/1.0" 202 Accepted 2026-05-10 01:37:13,748 - lava_callback - INFO - Starting async job submit for node 69fd3e39197af08e45fc5f68 2026-05-10 01:37:13,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:37:13,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3e39197af08e45fc5f68 HTTP/1.1" 200 None 2026-05-10 01:37:13,768 - lava_callback - DEBUG - Processing node 69fd3e39197af08e45fc5f68: baseline-arm64-clabbe 2026-05-10 01:37:13,768 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3e39197af08e45fc5f68 2026-05-10 01:37:13,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:37:13,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3e39197af08e45fc5f68 HTTP/1.1" 200 None 2026-05-10 01:37:13,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:37:13,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:37:13,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:37:13,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3e39197af08e45fc5f68 HTTP/1.1" 200 None 2026-05-10 01:37:13,829 - lava_callback - ERROR - Error processing callback for node 69fd3e39197af08e45fc5f68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59902 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:38:33,723 - lava_callback - INFO - Received callback for node 69fd3e86197af08e45fc5f8c INFO: 172.20.0.1:36892 - "POST /node/69fd3e86197af08e45fc5f8c HTTP/1.0" 202 Accepted 2026-05-10 01:38:33,729 - lava_callback - INFO - Starting async job submit for node 69fd3e86197af08e45fc5f8c 2026-05-10 01:38:33,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:38:33,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3e86197af08e45fc5f8c HTTP/1.1" 200 None 2026-05-10 01:38:33,744 - lava_callback - DEBUG - Processing node 69fd3e86197af08e45fc5f8c: baseline-arm64-clabbe 2026-05-10 01:38:33,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3e86197af08e45fc5f8c 2026-05-10 01:38:33,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:38:33,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3e86197af08e45fc5f8c HTTP/1.1" 200 None 2026-05-10 01:38:33,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:38:33,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:38:33,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:38:33,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3e86197af08e45fc5f8c HTTP/1.1" 200 None 2026-05-10 01:38:33,790 - lava_callback - ERROR - Error processing callback for node 69fd3e86197af08e45fc5f8c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34456 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:39:01,508 - lava_callback - INFO - Received callback for node 69ffe1418d5045ce94721583 INFO: 172.20.0.1:60424 - "POST /node/69ffe1418d5045ce94721583 HTTP/1.0" 202 Accepted 2026-05-10 01:39:01,514 - lava_callback - INFO - Starting async job submit for node 69ffe1418d5045ce94721583 2026-05-10 01:39:01,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:01,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe1418d5045ce94721583 HTTP/1.1" 200 None 2026-05-10 01:39:01,552 - lava_callback - DEBUG - Processing node 69ffe1418d5045ce94721583: baseline-arm64-broonie 2026-05-10 01:39:01,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:39:01,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:39:01,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffe1418d5045ce94721583/log.txt.gz 2026-05-10 01:39:02,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:39:02,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:39:02,241 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffe1418d5045ce94721583/lava-logs.yaml 2026-05-10 01:39:02,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:39:02,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:39:02,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ffe1418d5045ce94721583/lava_callback.json.gz 2026-05-10 01:39:02,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:02,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe1418d5045ce94721583 HTTP/1.1" 200 None 2026-05-10 01:39:02,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:02,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:39:02,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:02,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe1418d5045ce94721583 HTTP/1.1" 200 None 2026-05-10 01:39:02,433 - lava_callback - INFO - Completed processing callback for node 69ffe1418d5045ce94721583 INFO: 172.20.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49152 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:39:32,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:32,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 01:39:33,801 - lava_callback - INFO - Received callback for node 69fd3ed2197af08e45fc5fa8 INFO: 172.20.0.1:42056 - "POST /node/69fd3ed2197af08e45fc5fa8 HTTP/1.0" 202 Accepted 2026-05-10 01:39:33,807 - lava_callback - INFO - Starting async job submit for node 69fd3ed2197af08e45fc5fa8 2026-05-10 01:39:33,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:33,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ed2197af08e45fc5fa8 HTTP/1.1" 200 None 2026-05-10 01:39:33,824 - lava_callback - DEBUG - Processing node 69fd3ed2197af08e45fc5fa8: baseline-arm64-clabbe 2026-05-10 01:39:33,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3ed2197af08e45fc5fa8 2026-05-10 01:39:33,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:33,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3ed2197af08e45fc5fa8 HTTP/1.1" 200 None 2026-05-10 01:39:33,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:33,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:39:33,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:39:33,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3ed2197af08e45fc5fa8 HTTP/1.1" 200 None 2026-05-10 01:39:33,889 - lava_callback - ERROR - Error processing callback for node 69fd3ed2197af08e45fc5fa8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46106 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:40:12,894 - lava_callback - INFO - Received callback for node 69ffdd6b8d5045ce94721373 INFO: 172.20.0.1:44702 - "POST /node/69ffdd6b8d5045ce94721373 HTTP/1.0" 202 Accepted 2026-05-10 01:40:12,941 - lava_callback - INFO - Starting async job submit for node 69ffdd6b8d5045ce94721373 2026-05-10 01:40:12,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:12,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdd6b8d5045ce94721373 HTTP/1.1" 200 None 2026-05-10 01:40:12,990 - lava_callback - DEBUG - Processing node 69ffdd6b8d5045ce94721373: baseline-arm-pengutronix 2026-05-10 01:40:13,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:40:13,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:40:13,216 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffdd6b8d5045ce94721373/log.txt.gz 2026-05-10 01:40:13,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:40:13,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:40:13,421 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffdd6b8d5045ce94721373/lava-logs.yaml 2026-05-10 01:40:13,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:40:13,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:40:13,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffdd6b8d5045ce94721373/lava_callback.json.gz DEBUG: Setup failed for 69ffdd6b8d5045ce94721373. Transitting job node result: incomplete -> fail 2026-05-10 01:40:13,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:13,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffdd6b8d5045ce94721373 HTTP/1.1" 200 None 2026-05-10 01:40:13,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:13,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 01:40:13,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:13,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffdd6b8d5045ce94721373 HTTP/1.1" 200 None 2026-05-10 01:40:13,662 - lava_callback - INFO - Completed processing callback for node 69ffdd6b8d5045ce94721373 INFO: 172.20.0.1:44706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46714 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:40:32,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:32,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38438 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:40:53,952 - lava_callback - INFO - Received callback for node 69fd3f1f197af08e45fc5fcd INFO: 172.20.0.1:54268 - "POST /node/69fd3f1f197af08e45fc5fcd HTTP/1.0" 202 Accepted 2026-05-10 01:40:53,958 - lava_callback - INFO - Starting async job submit for node 69fd3f1f197af08e45fc5fcd 2026-05-10 01:40:53,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:53,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3f1f197af08e45fc5fcd HTTP/1.1" 200 None 2026-05-10 01:40:53,973 - lava_callback - DEBUG - Processing node 69fd3f1f197af08e45fc5fcd: baseline-arm64-clabbe 2026-05-10 01:40:53,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3f1f197af08e45fc5fcd 2026-05-10 01:40:53,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:53,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3f1f197af08e45fc5fcd HTTP/1.1" 200 None 2026-05-10 01:40:53,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:54,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 01:40:54,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:40:54,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3f1f197af08e45fc5fcd HTTP/1.1" 200 None 2026-05-10 01:40:54,021 - lava_callback - ERROR - Error processing callback for node 69fd3f1f197af08e45fc5fcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45184 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:41:39,783 - lava_callback - INFO - Received callback for node 69ffe2368d5045ce9472160c INFO: 172.20.0.1:43428 - "POST /node/69ffe2368d5045ce9472160c HTTP/1.0" 202 Accepted 2026-05-10 01:41:39,788 - lava_callback - INFO - Starting async job submit for node 69ffe2368d5045ce9472160c 2026-05-10 01:41:39,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:39,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe2368d5045ce9472160c HTTP/1.1" 200 None 2026-05-10 01:41:39,809 - lava_callback - DEBUG - Processing node 69ffe2368d5045ce9472160c: baseline-nfs-arm64 2026-05-10 01:41:39,810 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:41:39,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:41:39,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:41:39,971 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe2368d5045ce9472160c/lava-logs.yaml 2026-05-10 01:41:39,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:41:40,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:41:40,059 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe2368d5045ce9472160c/lava_callback.json.gz 2026-05-10 01:41:40,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:40,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe2368d5045ce9472160c HTTP/1.1" 200 None 2026-05-10 01:41:40,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:40,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:41:40,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:40,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe2368d5045ce9472160c HTTP/1.1" 200 None 2026-05-10 01:41:40,115 - lava_callback - INFO - Completed processing callback for node 69ffe2368d5045ce9472160c INFO: 172.20.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:41:59,661 - lava_callback - INFO - Received callback for node 69fd3f64197af08e45fc5fea INFO: 172.20.0.1:42592 - "POST /node/69fd3f64197af08e45fc5fea HTTP/1.0" 202 Accepted 2026-05-10 01:41:59,666 - lava_callback - INFO - Starting async job submit for node 69fd3f64197af08e45fc5fea 2026-05-10 01:41:59,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:59,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3f64197af08e45fc5fea HTTP/1.1" 200 None 2026-05-10 01:41:59,682 - lava_callback - DEBUG - Processing node 69fd3f64197af08e45fc5fea: baseline-arm64-baylibre 2026-05-10 01:41:59,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3f64197af08e45fc5fea 2026-05-10 01:41:59,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:59,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3f64197af08e45fc5fea HTTP/1.1" 200 None 2026-05-10 01:41:59,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:59,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 01:41:59,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:41:59,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3f64197af08e45fc5fea HTTP/1.1" 200 None 2026-05-10 01:41:59,729 - lava_callback - ERROR - Error processing callback for node 69fd3f64197af08e45fc5fea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-05-10 01:42:02,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:42:02,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40844 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:42:21,762 - lava_callback - INFO - Received callback for node 69ffe1948d5045ce947215b3 INFO: 172.20.0.1:45666 - "POST /node/69ffe1948d5045ce947215b3 HTTP/1.0" 202 Accepted 2026-05-10 01:42:21,768 - lava_callback - INFO - Starting async job submit for node 69ffe1948d5045ce947215b3 2026-05-10 01:42:21,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:42:21,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe1948d5045ce947215b3 HTTP/1.1" 200 None 2026-05-10 01:42:21,808 - lava_callback - DEBUG - Processing node 69ffe1948d5045ce947215b3: ltp-fs_bind INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:42:22,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:42:22,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:42:22,311 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ffe1948d5045ce947215b3/log.txt.gz 2026-05-10 01:42:22,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:42:22,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:42:22,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ffe1948d5045ce947215b3/lava-logs.yaml 2026-05-10 01:42:22,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:42:22,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:42:22,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ffe1948d5045ce947215b3/lava_callback.json.gz 2026-05-10 01:42:22,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:42:22,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe1948d5045ce947215b3 HTTP/1.1" 200 None 2026-05-10 01:42:22,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:42:22,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 01:42:22,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:42:22,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe1948d5045ce947215b3 HTTP/1.1" 200 None 2026-05-10 01:42:22,878 - lava_callback - INFO - Completed processing callback for node 69ffe1948d5045ce947215b3 INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:42:32,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:42:32,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56330 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:43:19,527 - lava_callback - INFO - Received callback for node 69fd3fb0197af08e45fc600f INFO: 172.20.0.1:56336 - "POST /node/69fd3fb0197af08e45fc600f HTTP/1.0" 202 Accepted 2026-05-10 01:43:19,532 - lava_callback - INFO - Starting async job submit for node 69fd3fb0197af08e45fc600f 2026-05-10 01:43:19,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:43:19,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3fb0197af08e45fc600f HTTP/1.1" 200 None 2026-05-10 01:43:19,548 - lava_callback - DEBUG - Processing node 69fd3fb0197af08e45fc600f: baseline-arm64-baylibre 2026-05-10 01:43:19,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd3fb0197af08e45fc600f 2026-05-10 01:43:19,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:43:19,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd3fb0197af08e45fc600f HTTP/1.1" 200 None 2026-05-10 01:43:19,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:43:19,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 01:43:19,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:43:19,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd3fb0197af08e45fc600f HTTP/1.1" 200 None 2026-05-10 01:43:19,595 - lava_callback - ERROR - Error processing callback for node 69fd3fb0197af08e45fc600f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42192 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:43:59,872 - lava_callback - INFO - Received callback for node 69ffe1a18d5045ce947215bc INFO: 172.20.0.1:43864 - "POST /node/69ffe1a18d5045ce947215bc HTTP/1.0" 202 Accepted 2026-05-10 01:43:59,879 - lava_callback - INFO - Starting async job submit for node 69ffe1a18d5045ce947215bc 2026-05-10 01:43:59,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:43:59,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe1a18d5045ce947215bc HTTP/1.1" 200 None 2026-05-10 01:43:59,930 - lava_callback - DEBUG - Processing node 69ffe1a18d5045ce947215bc: baseline-arm64 2026-05-10 01:44:00,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:44:00,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:44:00,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe1a18d5045ce947215bc/log.txt.gz 2026-05-10 01:44:00,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:44:00,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:44:00,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe1a18d5045ce947215bc/lava-logs.yaml 2026-05-10 01:44:00,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:44:00,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:44:00,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe1a18d5045ce947215bc/lava_callback.json.gz DEBUG: Setup failed for 69ffe1a18d5045ce947215bc. Transitting job node result: incomplete -> fail 2026-05-10 01:44:01,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:44:01,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe1a18d5045ce947215bc HTTP/1.1" 200 None 2026-05-10 01:44:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:44:01,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:44:01,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:44:01,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe1a18d5045ce947215bc HTTP/1.1" 200 None 2026-05-10 01:44:01,210 - lava_callback - INFO - Completed processing callback for node 69ffe1a18d5045ce947215bc 2026-05-10 01:44:02,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:44:02,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57962 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:47:39,739 - lava_callback - INFO - Received callback for node 69fd40b5197af08e45fc6086 INFO: 172.20.0.1:41754 - "POST /node/69fd40b5197af08e45fc6086 HTTP/1.0" 202 Accepted 2026-05-10 01:47:39,748 - lava_callback - INFO - Starting async job submit for node 69fd40b5197af08e45fc6086 2026-05-10 01:47:39,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:47:39,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd40b5197af08e45fc6086 HTTP/1.1" 200 None 2026-05-10 01:47:39,764 - lava_callback - DEBUG - Processing node 69fd40b5197af08e45fc6086: baseline-arm64-baylibre 2026-05-10 01:47:39,764 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd40b5197af08e45fc6086 2026-05-10 01:47:39,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:47:39,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd40b5197af08e45fc6086 HTTP/1.1" 200 None 2026-05-10 01:47:39,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:47:39,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 01:47:39,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:47:39,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd40b5197af08e45fc6086 HTTP/1.1" 200 None 2026-05-10 01:47:39,810 - lava_callback - ERROR - Error processing callback for node 69fd40b5197af08e45fc6086: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49194 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:48:59,794 - lava_callback - INFO - Received callback for node 69fd4101197af08e45fc60b5 INFO: 172.20.0.1:41550 - "POST /node/69fd4101197af08e45fc60b5 HTTP/1.0" 202 Accepted 2026-05-10 01:48:59,800 - lava_callback - INFO - Starting async job submit for node 69fd4101197af08e45fc60b5 2026-05-10 01:48:59,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:48:59,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4101197af08e45fc60b5 HTTP/1.1" 200 None 2026-05-10 01:48:59,819 - lava_callback - DEBUG - Processing node 69fd4101197af08e45fc60b5: baseline-arm64-baylibre 2026-05-10 01:48:59,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4101197af08e45fc60b5 2026-05-10 01:48:59,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:48:59,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4101197af08e45fc60b5 HTTP/1.1" 200 None 2026-05-10 01:48:59,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:48:59,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 01:48:59,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:48:59,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4101197af08e45fc60b5 HTTP/1.1" 200 None 2026-05-10 01:48:59,864 - lava_callback - ERROR - Error processing callback for node 69fd4101197af08e45fc60b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55274 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:50:22,350 - lava_callback - INFO - Received callback for node 69ffe4378d5045ce9472172b INFO: 172.20.0.1:55280 - "POST /node/69ffe4378d5045ce9472172b HTTP/1.0" 202 Accepted 2026-05-10 01:50:22,357 - lava_callback - INFO - Starting async job submit for node 69ffe4378d5045ce9472172b 2026-05-10 01:50:22,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:50:22,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe4378d5045ce9472172b HTTP/1.1" 200 None 2026-05-10 01:50:22,401 - lava_callback - DEBUG - Processing node 69ffe4378d5045ce9472172b: baseline-arm64 2026-05-10 01:50:22,531 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:50:22,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:50:22,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:50:22,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe4378d5045ce9472172b/lava-logs.yaml 2026-05-10 01:50:22,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:50:22,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:50:22,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe4378d5045ce9472172b/lava_callback.json.gz 2026-05-10 01:50:22,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:50:22,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe4378d5045ce9472172b HTTP/1.1" 200 None 2026-05-10 01:50:22,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:50:22,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:50:22,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:50:22,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe4378d5045ce9472172b HTTP/1.1" 200 None 2026-05-10 01:50:23,018 - lava_callback - INFO - Completed processing callback for node 69ffe4378d5045ce9472172b INFO: 172.20.0.1:55296 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:50:32,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:50:32,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34780 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:53:29,506 - lava_callback - INFO - Received callback for node 69ffe4cb8d5045ce94721778 INFO: 172.20.0.1:34788 - "POST /node/69ffe4cb8d5045ce94721778 HTTP/1.0" 202 Accepted 2026-05-10 01:53:29,513 - lava_callback - INFO - Starting async job submit for node 69ffe4cb8d5045ce94721778 2026-05-10 01:53:29,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:53:29,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe4cb8d5045ce94721778 HTTP/1.1" 200 None 2026-05-10 01:53:29,559 - lava_callback - DEBUG - Processing node 69ffe4cb8d5045ce94721778: baseline-arm64 2026-05-10 01:53:29,765 - lava_callback - WARNING - Failed to upload log 2026-05-10 01:53:29,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:53:30,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:53:30,015 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe4cb8d5045ce94721778/lava-logs.yaml 2026-05-10 01:53:30,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:53:30,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:53:30,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe4cb8d5045ce94721778/lava_callback.json.gz 2026-05-10 01:53:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:53:30,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe4cb8d5045ce94721778 HTTP/1.1" 200 None 2026-05-10 01:53:30,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:53:30,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:53:30,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:53:30,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe4cb8d5045ce94721778 HTTP/1.1" 200 None 2026-05-10 01:53:30,299 - lava_callback - INFO - Completed processing callback for node 69ffe4cb8d5045ce94721778 2026-05-10 01:53:32,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:53:32,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58962 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:55:20,123 - lava_callback - INFO - Received callback for node 69fd4279197af08e45fc616c INFO: 172.20.0.1:44290 - "POST /node/69fd4279197af08e45fc616c HTTP/1.0" 202 Accepted 2026-05-10 01:55:20,128 - lava_callback - INFO - Starting async job submit for node 69fd4279197af08e45fc616c 2026-05-10 01:55:20,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:20,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4279197af08e45fc616c HTTP/1.1" 200 None 2026-05-10 01:55:20,143 - lava_callback - DEBUG - Processing node 69fd4279197af08e45fc616c: baseline-arm64-baylibre 2026-05-10 01:55:20,143 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4279197af08e45fc616c 2026-05-10 01:55:20,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:20,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4279197af08e45fc616c HTTP/1.1" 200 None 2026-05-10 01:55:20,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:20,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 01:55:20,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:20,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4279197af08e45fc616c HTTP/1.1" 200 None 2026-05-10 01:55:20,200 - lava_callback - ERROR - Error processing callback for node 69fd4279197af08e45fc616c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44314 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:55:35,904 - lava_callback - INFO - Received callback for node 69ffe0ea8d5045ce94721551 INFO: 172.20.0.1:55014 - "POST /node/69ffe0ea8d5045ce94721551 HTTP/1.0" 202 Accepted 2026-05-10 01:55:35,918 - lava_callback - INFO - Starting async job submit for node 69ffe0ea8d5045ce94721551 2026-05-10 01:55:35,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:35,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe0ea8d5045ce94721551 HTTP/1.1" 200 None 2026-05-10 01:55:35,981 - lava_callback - DEBUG - Processing node 69ffe0ea8d5045ce94721551: baseline-nfs-arm64 INFO: 172.20.0.1:55024 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:55:37,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:55:37,193 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:55:37,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe0ea8d5045ce94721551/log.txt.gz 2026-05-10 01:55:37,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:55:38,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:55:38,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe0ea8d5045ce94721551/lava-logs.yaml 2026-05-10 01:55:38,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 01:55:38,394 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 01:55:38,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe0ea8d5045ce94721551/lava_callback.json.gz DEBUG: Setup failed for 69ffe0ea8d5045ce94721551. Transitting job node result: incomplete -> fail 2026-05-10 01:55:38,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe0ea8d5045ce94721551 HTTP/1.1" 200 None 2026-05-10 01:55:38,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:38,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 01:55:38,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:55:38,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe0ea8d5045ce94721551 HTTP/1.1" 200 None 2026-05-10 01:55:38,633 - lava_callback - INFO - Completed processing callback for node 69ffe0ea8d5045ce94721551 INFO: 172.20.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37056 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:56:02,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:56:02,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43116 - "GET / HTTP/1.0" 200 OK 2026-05-10 01:57:40,298 - lava_callback - INFO - Received callback for node 69fd4312197af08e45fc61b5 INFO: 172.20.0.1:56438 - "POST /node/69fd4312197af08e45fc61b5 HTTP/1.0" 202 Accepted 2026-05-10 01:57:40,304 - lava_callback - INFO - Starting async job submit for node 69fd4312197af08e45fc61b5 2026-05-10 01:57:40,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:57:40,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4312197af08e45fc61b5 HTTP/1.1" 200 None 2026-05-10 01:57:40,331 - lava_callback - DEBUG - Processing node 69fd4312197af08e45fc61b5: baseline-arm64-baylibre 2026-05-10 01:57:40,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4312197af08e45fc61b5 2026-05-10 01:57:40,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:57:40,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4312197af08e45fc61b5 HTTP/1.1" 200 None 2026-05-10 01:57:40,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:57:40,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 01:57:40,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 01:57:40,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4312197af08e45fc61b5 HTTP/1.1" 200 None 2026-05-10 01:57:40,385 - lava_callback - ERROR - Error processing callback for node 69fd4312197af08e45fc61b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51192 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:00:34,799 - lava_callback - INFO - Received callback for node 69fd43b0197af08e45fc61f7 INFO: 172.20.0.1:43742 - "POST /node/69fd43b0197af08e45fc61f7 HTTP/1.0" 202 Accepted 2026-05-10 02:00:34,807 - lava_callback - INFO - Starting async job submit for node 69fd43b0197af08e45fc61f7 2026-05-10 02:00:34,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:00:34,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd43b0197af08e45fc61f7 HTTP/1.1" 200 None 2026-05-10 02:00:34,828 - lava_callback - DEBUG - Processing node 69fd43b0197af08e45fc61f7: baseline-arm64-clabbe 2026-05-10 02:00:34,828 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd43b0197af08e45fc61f7 2026-05-10 02:00:34,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:00:34,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd43b0197af08e45fc61f7 HTTP/1.1" 200 None 2026-05-10 02:00:34,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:00:34,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 02:00:34,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:00:34,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd43b0197af08e45fc61f7 HTTP/1.1" 200 None 2026-05-10 02:00:34,888 - lava_callback - ERROR - Error processing callback for node 69fd43b0197af08e45fc61f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60394 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:01:00,331 - lava_callback - INFO - Received callback for node 69ffe2bf8d5045ce94721661 INFO: 172.20.0.1:34670 - "POST /node/69ffe2bf8d5045ce94721661 HTTP/1.0" 202 Accepted 2026-05-10 02:01:00,341 - lava_callback - INFO - Starting async job submit for node 69ffe2bf8d5045ce94721661 2026-05-10 02:01:00,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:00,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe2bf8d5045ce94721661 HTTP/1.1" 200 None 2026-05-10 02:01:00,419 - lava_callback - DEBUG - Processing node 69ffe2bf8d5045ce94721661: ltp-smoke 2026-05-10 02:01:00,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:01:01,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:01:01,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffe2bf8d5045ce94721661/log.txt.gz 2026-05-10 02:01:01,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:01:01,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:01:01,535 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffe2bf8d5045ce94721661/lava-logs.yaml 2026-05-10 02:01:01,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:01:01,664 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:01:01,665 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffe2bf8d5045ce94721661/lava_callback.json.gz 2026-05-10 02:01:01,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:01,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe2bf8d5045ce94721661 HTTP/1.1" 200 None 2026-05-10 02:01:01,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:01,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce858d5045ce9471e366 HTTP/1.1" 200 None 2026-05-10 02:01:01,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:01,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe2bf8d5045ce94721661 HTTP/1.1" 200 None 2026-05-10 02:01:01,954 - lava_callback - INFO - Completed processing callback for node 69ffe2bf8d5045ce94721661 2026-05-10 02:01:02,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:02,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50974 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:01:54,808 - lava_callback - INFO - Received callback for node 69fd4401197af08e45fc621e INFO: 172.20.0.1:55368 - "POST /node/69fd4401197af08e45fc621e HTTP/1.0" 202 Accepted 2026-05-10 02:01:54,814 - lava_callback - INFO - Starting async job submit for node 69fd4401197af08e45fc621e 2026-05-10 02:01:54,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:54,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4401197af08e45fc621e HTTP/1.1" 200 None 2026-05-10 02:01:54,829 - lava_callback - DEBUG - Processing node 69fd4401197af08e45fc621e: baseline-arm64-clabbe 2026-05-10 02:01:54,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4401197af08e45fc621e 2026-05-10 02:01:54,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:54,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4401197af08e45fc621e HTTP/1.1" 200 None 2026-05-10 02:01:54,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:54,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 02:01:54,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:01:54,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4401197af08e45fc621e HTTP/1.1" 200 None 2026-05-10 02:01:54,874 - lava_callback - ERROR - Error processing callback for node 69fd4401197af08e45fc621e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54540 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:06:34,950 - lava_callback - INFO - Received callback for node 69fd4520197af08e45fc628a INFO: 172.20.0.1:60490 - "POST /node/69fd4520197af08e45fc628a HTTP/1.0" 202 Accepted 2026-05-10 02:06:34,956 - lava_callback - INFO - Starting async job submit for node 69fd4520197af08e45fc628a 2026-05-10 02:06:34,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:06:34,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4520197af08e45fc628a HTTP/1.1" 200 None 2026-05-10 02:06:34,972 - lava_callback - DEBUG - Processing node 69fd4520197af08e45fc628a: baseline-arm64-clabbe 2026-05-10 02:06:34,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4520197af08e45fc628a 2026-05-10 02:06:34,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:06:34,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4520197af08e45fc628a HTTP/1.1" 200 None 2026-05-10 02:06:34,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:06:35,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 02:06:35,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:06:35,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4520197af08e45fc628a HTTP/1.1" 200 None 2026-05-10 02:06:35,022 - lava_callback - ERROR - Error processing callback for node 69fd4520197af08e45fc628a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:08:12,234 - lava_callback - INFO - Received callback for node 69ffe6d38d5045ce94721870 INFO: 172.20.0.1:60482 - "POST /node/69ffe6d38d5045ce94721870 HTTP/1.0" 202 Accepted 2026-05-10 02:08:12,247 - lava_callback - INFO - Starting async job submit for node 69ffe6d38d5045ce94721870 2026-05-10 02:08:12,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:08:12,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe6d38d5045ce94721870 HTTP/1.1" 200 None 2026-05-10 02:08:12,315 - lava_callback - DEBUG - Processing node 69ffe6d38d5045ce94721870: baseline-arm64 2026-05-10 02:08:12,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:08:12,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:08:12,857 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe6d38d5045ce94721870/log.txt.gz 2026-05-10 02:08:13,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:08:13,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:08:13,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe6d38d5045ce94721870/lava-logs.yaml 2026-05-10 02:08:13,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:08:13,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:08:13,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ffe6d38d5045ce94721870/lava_callback.json.gz DEBUG: Setup failed for 69ffe6d38d5045ce94721870. Transitting job node result: incomplete -> fail 2026-05-10 02:08:13,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:08:13,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe6d38d5045ce94721870 HTTP/1.1" 200 None 2026-05-10 02:08:13,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:08:13,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 02:08:13,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:08:13,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe6d38d5045ce94721870 HTTP/1.1" 200 None 2026-05-10 02:08:13,587 - lava_callback - INFO - Completed processing callback for node 69ffe6d38d5045ce94721870 INFO: 172.20.0.1:60490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47638 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:08:32,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:08:32,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54328 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:09:15,091 - lava_callback - INFO - Received callback for node 69fd45bc197af08e45fc62c6 INFO: 172.20.0.1:56748 - "POST /node/69fd45bc197af08e45fc62c6 HTTP/1.0" 202 Accepted 2026-05-10 02:09:15,100 - lava_callback - INFO - Starting async job submit for node 69fd45bc197af08e45fc62c6 2026-05-10 02:09:15,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:09:15,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd45bc197af08e45fc62c6 HTTP/1.1" 200 None 2026-05-10 02:09:15,119 - lava_callback - DEBUG - Processing node 69fd45bc197af08e45fc62c6: baseline-arm64-clabbe 2026-05-10 02:09:15,119 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd45bc197af08e45fc62c6 2026-05-10 02:09:15,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:09:15,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd45bc197af08e45fc62c6 HTTP/1.1" 200 None 2026-05-10 02:09:15,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:09:15,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 02:09:15,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:09:15,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd45bc197af08e45fc62c6 HTTP/1.1" 200 None 2026-05-10 02:09:15,174 - lava_callback - ERROR - Error processing callback for node 69fd45bc197af08e45fc62c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37534 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:11:15,135 - lava_callback - INFO - Received callback for node 69fd4631197af08e45fc62fd INFO: 172.20.0.1:60076 - "POST /node/69fd4631197af08e45fc62fd HTTP/1.0" 202 Accepted 2026-05-10 02:11:15,140 - lava_callback - INFO - Starting async job submit for node 69fd4631197af08e45fc62fd 2026-05-10 02:11:15,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:15,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4631197af08e45fc62fd HTTP/1.1" 200 None 2026-05-10 02:11:15,156 - lava_callback - DEBUG - Processing node 69fd4631197af08e45fc62fd: baseline-arm64-clabbe 2026-05-10 02:11:15,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4631197af08e45fc62fd 2026-05-10 02:11:15,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:60084 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 02:11:15,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4631197af08e45fc62fd HTTP/1.1" 200 None 2026-05-10 02:11:15,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:15,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 02:11:15,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4631197af08e45fc62fd HTTP/1.1" 200 None 2026-05-10 02:11:15,201 - lava_callback - ERROR - Error processing callback for node 69fd4631197af08e45fc62fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60094 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:11:18,298 - lava_callback - INFO - Received callback for node 69ffe55e8d5045ce947217b8 INFO: 172.20.0.1:60096 - "POST /node/69ffe55e8d5045ce947217b8 HTTP/1.0" 202 Accepted 2026-05-10 02:11:18,309 - lava_callback - INFO - Starting async job submit for node 69ffe55e8d5045ce947217b8 2026-05-10 02:11:18,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:18,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe55e8d5045ce947217b8 HTTP/1.1" 200 None 2026-05-10 02:11:18,387 - lava_callback - DEBUG - Processing node 69ffe55e8d5045ce947217b8: baseline-arm 2026-05-10 02:11:19,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:11:19,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:11:19,119 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffe55e8d5045ce947217b8/log.txt.gz 2026-05-10 02:11:19,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:11:19,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:11:19,650 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffe55e8d5045ce947217b8/lava-logs.yaml 2026-05-10 02:11:19,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:11:19,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:11:19,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffe55e8d5045ce947217b8/lava_callback.json.gz DEBUG: Setup failed for 69ffe55e8d5045ce947217b8. Transitting job node result: incomplete -> fail 2026-05-10 02:11:19,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:19,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe55e8d5045ce947217b8 HTTP/1.1" 200 None 2026-05-10 02:11:19,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:19,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 02:11:19,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:19,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe55e8d5045ce947217b8 HTTP/1.1" 200 None 2026-05-10 02:11:20,068 - lava_callback - INFO - Completed processing callback for node 69ffe55e8d5045ce947217b8 INFO: 172.20.0.1:44472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44484 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:11:32,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:11:32,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60616 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:12:35,285 - lava_callback - INFO - Received callback for node 69fd467f197af08e45fc6320 INFO: 172.20.0.1:42490 - "POST /node/69fd467f197af08e45fc6320 HTTP/1.0" 202 Accepted 2026-05-10 02:12:35,290 - lava_callback - INFO - Starting async job submit for node 69fd467f197af08e45fc6320 2026-05-10 02:12:35,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:12:35,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd467f197af08e45fc6320 HTTP/1.1" 200 None 2026-05-10 02:12:35,306 - lava_callback - DEBUG - Processing node 69fd467f197af08e45fc6320: baseline-arm64-clabbe 2026-05-10 02:12:35,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd467f197af08e45fc6320 2026-05-10 02:12:35,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:12:35,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd467f197af08e45fc6320 HTTP/1.1" 200 None 2026-05-10 02:12:35,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:12:35,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f5446ded4ed40b0223db13 HTTP/1.1" 200 None 2026-05-10 02:12:35,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:12:35,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd467f197af08e45fc6320 HTTP/1.1" 200 None 2026-05-10 02:12:35,359 - lava_callback - ERROR - Error processing callback for node 69fd467f197af08e45fc6320: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43980 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:13:41,224 - lava_callback - INFO - Received callback for node 69fd46c2197af08e45fc633a INFO: 172.20.0.1:48952 - "POST /node/69fd46c2197af08e45fc633a HTTP/1.0" 202 Accepted 2026-05-10 02:13:41,229 - lava_callback - INFO - Starting async job submit for node 69fd46c2197af08e45fc633a 2026-05-10 02:13:41,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:13:41,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd46c2197af08e45fc633a HTTP/1.1" 200 None 2026-05-10 02:13:41,254 - lava_callback - DEBUG - Processing node 69fd46c2197af08e45fc633a: baseline-arm64-baylibre 2026-05-10 02:13:41,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd46c2197af08e45fc633a 2026-05-10 02:13:41,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:13:41,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd46c2197af08e45fc633a HTTP/1.1" 200 None 2026-05-10 02:13:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:13:41,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:13:41,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:13:41,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd46c2197af08e45fc633a HTTP/1.1" 200 None 2026-05-10 02:13:41,301 - lava_callback - ERROR - Error processing callback for node 69fd46c2197af08e45fc633a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58818 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:14:41,116 - lava_callback - INFO - Received callback for node 69fd470d197af08e45fc6356 INFO: 172.20.0.1:53984 - "POST /node/69fd470d197af08e45fc6356 HTTP/1.0" 202 Accepted 2026-05-10 02:14:41,123 - lava_callback - INFO - Starting async job submit for node 69fd470d197af08e45fc6356 2026-05-10 02:14:41,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:14:41,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd470d197af08e45fc6356 HTTP/1.1" 200 None 2026-05-10 02:14:41,139 - lava_callback - DEBUG - Processing node 69fd470d197af08e45fc6356: baseline-arm64-baylibre 2026-05-10 02:14:41,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd470d197af08e45fc6356 2026-05-10 02:14:41,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:14:41,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd470d197af08e45fc6356 HTTP/1.1" 200 None 2026-05-10 02:14:41,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:14:41,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:14:41,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:14:41,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd470d197af08e45fc6356 HTTP/1.1" 200 None 2026-05-10 02:14:41,196 - lava_callback - ERROR - Error processing callback for node 69fd470d197af08e45fc6356: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58206 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:16:01,210 - lava_callback - INFO - Received callback for node 69fd4758197af08e45fc6378 INFO: 172.20.0.1:38086 - "POST /node/69fd4758197af08e45fc6378 HTTP/1.0" 202 Accepted 2026-05-10 02:16:01,217 - lava_callback - INFO - Starting async job submit for node 69fd4758197af08e45fc6378 2026-05-10 02:16:01,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:16:01,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4758197af08e45fc6378 HTTP/1.1" 200 None 2026-05-10 02:16:01,234 - lava_callback - DEBUG - Processing node 69fd4758197af08e45fc6378: baseline-arm64-baylibre 2026-05-10 02:16:01,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4758197af08e45fc6378 2026-05-10 02:16:01,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:16:01,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4758197af08e45fc6378 HTTP/1.1" 200 None 2026-05-10 02:16:01,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:16:01,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:16:01,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:16:01,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4758197af08e45fc6378 HTTP/1.1" 200 None 2026-05-10 02:16:01,299 - lava_callback - ERROR - Error processing callback for node 69fd4758197af08e45fc6378: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48240 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:17:21,276 - lava_callback - INFO - Received callback for node 69fd47a5197af08e45fc63a0 INFO: 172.20.0.1:52338 - "POST /node/69fd47a5197af08e45fc63a0 HTTP/1.0" 202 Accepted 2026-05-10 02:17:21,282 - lava_callback - INFO - Starting async job submit for node 69fd47a5197af08e45fc63a0 2026-05-10 02:17:21,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:17:21,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd47a5197af08e45fc63a0 HTTP/1.1" 200 None 2026-05-10 02:17:21,297 - lava_callback - DEBUG - Processing node 69fd47a5197af08e45fc63a0: baseline-arm64-baylibre 2026-05-10 02:17:21,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd47a5197af08e45fc63a0 2026-05-10 02:17:21,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:17:21,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd47a5197af08e45fc63a0 HTTP/1.1" 200 None 2026-05-10 02:17:21,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:17:21,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:17:21,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:17:21,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd47a5197af08e45fc63a0 HTTP/1.1" 200 None 2026-05-10 02:17:21,341 - lava_callback - ERROR - Error processing callback for node 69fd47a5197af08e45fc63a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37372 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:18:34,678 - lava_callback - INFO - Received callback for node 69ffe6698d5045ce9472183c INFO: 172.20.0.1:38610 - "POST /node/69ffe6698d5045ce9472183c HTTP/1.0" 202 Accepted 2026-05-10 02:18:34,729 - lava_callback - INFO - Starting async job submit for node 69ffe6698d5045ce9472183c 2026-05-10 02:18:34,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:34,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe6698d5045ce9472183c HTTP/1.1" 200 None 2026-05-10 02:18:34,767 - lava_callback - DEBUG - Processing node 69ffe6698d5045ce9472183c: baseline-arm-pengutronix 2026-05-10 02:18:34,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:18:34,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:18:34,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffe6698d5045ce9472183c/log.txt.gz 2026-05-10 02:18:35,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:18:35,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:18:35,152 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffe6698d5045ce9472183c/lava-logs.yaml 2026-05-10 02:18:35,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:18:35,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:18:35,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffe6698d5045ce9472183c/lava_callback.json.gz DEBUG: Setup failed for 69ffe6698d5045ce9472183c. Transitting job node result: incomplete -> fail 2026-05-10 02:18:35,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:35,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe6698d5045ce9472183c HTTP/1.1" 200 None 2026-05-10 02:18:35,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:35,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 02:18:35,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:35,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe6698d5045ce9472183c HTTP/1.1" 200 None 2026-05-10 02:18:35,445 - lava_callback - INFO - Completed processing callback for node 69ffe6698d5045ce9472183c INFO: 172.20.0.1:38622 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:18:41,530 - lava_callback - INFO - Received callback for node 69fd47f0197af08e45fc63ba INFO: 172.20.0.1:57308 - "POST /node/69fd47f0197af08e45fc63ba HTTP/1.0" 202 Accepted 2026-05-10 02:18:41,537 - lava_callback - INFO - Starting async job submit for node 69fd47f0197af08e45fc63ba 2026-05-10 02:18:41,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:41,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd47f0197af08e45fc63ba HTTP/1.1" 200 None 2026-05-10 02:18:41,561 - lava_callback - DEBUG - Processing node 69fd47f0197af08e45fc63ba: baseline-arm64-baylibre 2026-05-10 02:18:41,561 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd47f0197af08e45fc63ba 2026-05-10 02:18:41,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:41,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd47f0197af08e45fc63ba HTTP/1.1" 200 None 2026-05-10 02:18:41,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:41,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:18:41,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:18:41,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd47f0197af08e45fc63ba HTTP/1.1" 200 None 2026-05-10 02:18:41,621 - lava_callback - ERROR - Error processing callback for node 69fd47f0197af08e45fc63ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58288 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:19:02,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:19:02,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57508 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:20:01,771 - lava_callback - INFO - Received callback for node 69fd483c197af08e45fc63e4 INFO: 172.20.0.1:34608 - "POST /node/69fd483c197af08e45fc63e4 HTTP/1.0" 202 Accepted 2026-05-10 02:20:01,780 - lava_callback - INFO - Starting async job submit for node 69fd483c197af08e45fc63e4 2026-05-10 02:20:01,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:01,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd483c197af08e45fc63e4 HTTP/1.1" 200 None 2026-05-10 02:20:01,796 - lava_callback - DEBUG - Processing node 69fd483c197af08e45fc63e4: baseline-arm64-baylibre 2026-05-10 02:20:01,796 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd483c197af08e45fc63e4 2026-05-10 02:20:01,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:01,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd483c197af08e45fc63e4 HTTP/1.1" 200 None 2026-05-10 02:20:01,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:01,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:20:01,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:01,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd483c197af08e45fc63e4 HTTP/1.1" 200 None 2026-05-10 02:20:01,852 - lava_callback - ERROR - Error processing callback for node 69fd483c197af08e45fc63e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51470 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:20:21,102 - lava_callback - INFO - Received callback for node 69ffe7618d5045ce947218c1 INFO: 172.20.0.1:56836 - "POST /node/69ffe7618d5045ce947218c1 HTTP/1.0" 202 Accepted 2026-05-10 02:20:21,111 - lava_callback - INFO - Starting async job submit for node 69ffe7618d5045ce947218c1 2026-05-10 02:20:21,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:21,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe7618d5045ce947218c1 HTTP/1.1" 200 None 2026-05-10 02:20:21,201 - lava_callback - DEBUG - Processing node 69ffe7618d5045ce947218c1: ltp-smoke 2026-05-10 02:20:21,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:20:21,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:20:21,774 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffe7618d5045ce947218c1/log.txt.gz 2026-05-10 02:20:22,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:20:22,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:20:22,223 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffe7618d5045ce947218c1/lava-logs.yaml 2026-05-10 02:20:22,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:20:22,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:20:22,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ffe7618d5045ce947218c1/lava_callback.json.gz 2026-05-10 02:20:22,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:20:22,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe7618d5045ce947218c1 HTTP/1.1" 200 None 2026-05-10 02:20:22,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:22,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce858d5045ce9471e366 HTTP/1.1" 200 None 2026-05-10 02:20:22,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:22,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe7618d5045ce947218c1 HTTP/1.1" 200 None 2026-05-10 02:20:22,675 - lava_callback - INFO - Completed processing callback for node 69ffe7618d5045ce947218c1 INFO: 172.20.0.1:56844 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:20:32,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:20:32,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40304 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 02:21:15,440 - lava_callback - INFO - Received callback for node 69fd488d197af08e45fc6402 INFO: 172.20.0.1:40310 - "POST /node/69fd488d197af08e45fc6402 HTTP/1.0" 202 Accepted 2026-05-10 02:21:15,445 - lava_callback - INFO - Starting async job submit for node 69fd488d197af08e45fc6402 2026-05-10 02:21:15,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:21:15,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd488d197af08e45fc6402 HTTP/1.1" 200 None 2026-05-10 02:21:15,465 - lava_callback - DEBUG - Processing node 69fd488d197af08e45fc6402: baseline-arm64-clabbe 2026-05-10 02:21:15,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd488d197af08e45fc6402 2026-05-10 02:21:15,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:21:15,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd488d197af08e45fc6402 HTTP/1.1" 200 None 2026-05-10 02:21:15,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:21:15,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:21:15,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:21:15,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd488d197af08e45fc6402 HTTP/1.1" 200 None 2026-05-10 02:21:15,511 - lava_callback - ERROR - Error processing callback for node 69fd488d197af08e45fc6402: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37846 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:22:11,553 - lava_callback - INFO - Received callback for node 69ffe71f8d5045ce94721899 INFO: 172.20.0.1:45934 - "POST /node/69ffe71f8d5045ce94721899 HTTP/1.0" 202 Accepted 2026-05-10 02:22:11,563 - lava_callback - INFO - Starting async job submit for node 69ffe71f8d5045ce94721899 2026-05-10 02:22:11,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:11,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe71f8d5045ce94721899 HTTP/1.1" 200 None 2026-05-10 02:22:11,636 - lava_callback - DEBUG - Processing node 69ffe71f8d5045ce94721899: baseline-nfs-arm64 2026-05-10 02:22:12,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:22:12,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:22:12,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe71f8d5045ce94721899/log.txt.gz 2026-05-10 02:22:13,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:22:13,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:22:13,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe71f8d5045ce94721899/lava-logs.yaml 2026-05-10 02:22:13,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:22:13,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:22:13,994 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffe71f8d5045ce94721899/lava_callback.json.gz DEBUG: Setup failed for 69ffe71f8d5045ce94721899. Transitting job node result: incomplete -> fail 2026-05-10 02:22:14,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:14,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe71f8d5045ce94721899 HTTP/1.1" 200 None 2026-05-10 02:22:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:14,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 02:22:14,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:14,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe71f8d5045ce94721899 HTTP/1.1" 200 None 2026-05-10 02:22:14,271 - lava_callback - INFO - Completed processing callback for node 69ffe71f8d5045ce94721899 INFO: 172.20.0.1:45950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52926 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:22:32,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:32,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-05-10 02:22:35,542 - lava_callback - INFO - Received callback for node 69fd48da197af08e45fc6436 INFO: 172.20.0.1:34660 - "POST /node/69fd48da197af08e45fc6436 HTTP/1.0" 202 Accepted 2026-05-10 02:22:35,548 - lava_callback - INFO - Starting async job submit for node 69fd48da197af08e45fc6436 2026-05-10 02:22:35,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:35,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd48da197af08e45fc6436 HTTP/1.1" 200 None 2026-05-10 02:22:35,563 - lava_callback - DEBUG - Processing node 69fd48da197af08e45fc6436: baseline-arm64-clabbe 2026-05-10 02:22:35,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd48da197af08e45fc6436 2026-05-10 02:22:35,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:35,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd48da197af08e45fc6436 HTTP/1.1" 200 None 2026-05-10 02:22:35,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:35,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:22:35,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:22:35,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd48da197af08e45fc6436 HTTP/1.1" 200 None 2026-05-10 02:22:35,622 - lava_callback - ERROR - Error processing callback for node 69fd48da197af08e45fc6436: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:23:55,542 - lava_callback - INFO - Received callback for node 69fd4927197af08e45fc645a INFO: 172.20.0.1:46720 - "POST /node/69fd4927197af08e45fc645a HTTP/1.0" 202 Accepted 2026-05-10 02:23:55,549 - lava_callback - INFO - Starting async job submit for node 69fd4927197af08e45fc645a 2026-05-10 02:23:55,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:23:55,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4927197af08e45fc645a HTTP/1.1" 200 None 2026-05-10 02:23:55,564 - lava_callback - DEBUG - Processing node 69fd4927197af08e45fc645a: baseline-arm64-clabbe 2026-05-10 02:23:55,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4927197af08e45fc645a 2026-05-10 02:23:55,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:23:55,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4927197af08e45fc645a HTTP/1.1" 200 None 2026-05-10 02:23:55,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:23:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:23:55,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:23:55,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4927197af08e45fc645a HTTP/1.1" 200 None 2026-05-10 02:23:55,637 - lava_callback - ERROR - Error processing callback for node 69fd4927197af08e45fc645a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:24:55,575 - lava_callback - INFO - Received callback for node 69fd4972197af08e45fc6487 INFO: 172.20.0.1:33476 - "POST /node/69fd4972197af08e45fc6487 HTTP/1.0" 202 Accepted 2026-05-10 02:24:55,581 - lava_callback - INFO - Starting async job submit for node 69fd4972197af08e45fc6487 2026-05-10 02:24:55,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:24:55,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4972197af08e45fc6487 HTTP/1.1" 200 None 2026-05-10 02:24:55,597 - lava_callback - DEBUG - Processing node 69fd4972197af08e45fc6487: baseline-arm64-clabbe 2026-05-10 02:24:55,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4972197af08e45fc6487 2026-05-10 02:24:55,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:24:55,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4972197af08e45fc6487 HTTP/1.1" 200 None 2026-05-10 02:24:55,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:24:55,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:24:55,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:24:55,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4972197af08e45fc6487 HTTP/1.1" 200 None 2026-05-10 02:24:55,646 - lava_callback - ERROR - Error processing callback for node 69fd4972197af08e45fc6487: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33480 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:27:35,696 - lava_callback - INFO - Received callback for node 69fd4a12197af08e45fc64cd INFO: 172.20.0.1:36402 - "POST /node/69fd4a12197af08e45fc64cd HTTP/1.0" 202 Accepted 2026-05-10 02:27:35,702 - lava_callback - INFO - Starting async job submit for node 69fd4a12197af08e45fc64cd 2026-05-10 02:27:35,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:27:35,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4a12197af08e45fc64cd HTTP/1.1" 200 None 2026-05-10 02:27:35,721 - lava_callback - DEBUG - Processing node 69fd4a12197af08e45fc64cd: baseline-arm64-clabbe 2026-05-10 02:27:35,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4a12197af08e45fc64cd 2026-05-10 02:27:35,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:27:35,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4a12197af08e45fc64cd HTTP/1.1" 200 None 2026-05-10 02:27:35,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:27:35,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:27:35,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:27:35,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4a12197af08e45fc64cd HTTP/1.1" 200 None 2026-05-10 02:27:35,768 - lava_callback - ERROR - Error processing callback for node 69fd4a12197af08e45fc64cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36254 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:28:09,131 - lava_callback - INFO - Received callback for node 69ffe9498d5045ce947218d4 INFO: 172.20.0.1:36258 - "POST /node/69ffe9498d5045ce947218d4 HTTP/1.0" 202 Accepted 2026-05-10 02:28:09,137 - lava_callback - INFO - Starting async job submit for node 69ffe9498d5045ce947218d4 2026-05-10 02:28:09,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:28:09,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe9498d5045ce947218d4 HTTP/1.1" 200 None 2026-05-10 02:28:09,206 - lava_callback - DEBUG - Processing node 69ffe9498d5045ce947218d4: baseline-arm 2026-05-10 02:28:09,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:28:10,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:28:10,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ffe9498d5045ce947218d4/log.txt.gz 2026-05-10 02:28:10,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:28:10,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:28:10,623 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ffe9498d5045ce947218d4/lava-logs.yaml 2026-05-10 02:28:10,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:28:10,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:28:10,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ffe9498d5045ce947218d4/lava_callback.json.gz DEBUG: Setup failed for 69ffe9498d5045ce947218d4. Transitting job node result: incomplete -> fail 2026-05-10 02:28:10,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:28:10,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffe9498d5045ce947218d4 HTTP/1.1" 200 None 2026-05-10 02:28:10,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:28:10,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 02:28:10,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:28:10,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffe9498d5045ce947218d4 HTTP/1.1" 200 None 2026-05-10 02:28:11,015 - lava_callback - INFO - Completed processing callback for node 69ffe9498d5045ce947218d4 INFO: 172.20.0.1:54628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55164 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:28:32,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:28:32,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58950 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 02:30:15,791 - lava_callback - INFO - Received callback for node 69fd4ab1197af08e45fc6525 INFO: 172.20.0.1:58962 - "POST /node/69fd4ab1197af08e45fc6525 HTTP/1.0" 202 Accepted 2026-05-10 02:30:15,796 - lava_callback - INFO - Starting async job submit for node 69fd4ab1197af08e45fc6525 2026-05-10 02:30:15,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:30:15,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4ab1197af08e45fc6525 HTTP/1.1" 200 None 2026-05-10 02:30:15,812 - lava_callback - DEBUG - Processing node 69fd4ab1197af08e45fc6525: baseline-arm64-clabbe 2026-05-10 02:30:15,812 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4ab1197af08e45fc6525 2026-05-10 02:30:15,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:30:15,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4ab1197af08e45fc6525 HTTP/1.1" 200 None 2026-05-10 02:30:15,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:30:15,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5c7559eef1735ba5759 HTTP/1.1" 200 None 2026-05-10 02:30:15,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:30:15,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4ab1197af08e45fc6525 HTTP/1.1" 200 None 2026-05-10 02:30:15,866 - lava_callback - ERROR - Error processing callback for node 69fd4ab1197af08e45fc6525: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58656 - "GET /node/6992fda331166481c8ddf04c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:58660 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:38:35,346 - lava_callback - INFO - Received callback for node 69ffeb158d5045ce9472197f INFO: 172.20.0.1:55048 - "POST /node/69ffeb158d5045ce9472197f HTTP/1.0" 202 Accepted 2026-05-10 02:38:35,393 - lava_callback - INFO - Starting async job submit for node 69ffeb158d5045ce9472197f 2026-05-10 02:38:35,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:38:35,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffeb158d5045ce9472197f HTTP/1.1" 200 None 2026-05-10 02:38:35,435 - lava_callback - DEBUG - Processing node 69ffeb158d5045ce9472197f: baseline-arm-pengutronix 2026-05-10 02:38:35,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:38:35,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:38:35,627 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffeb158d5045ce9472197f/log.txt.gz 2026-05-10 02:38:35,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:38:35,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:38:35,814 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffeb158d5045ce9472197f/lava-logs.yaml 2026-05-10 02:38:35,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:38:35,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:38:35,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ffeb158d5045ce9472197f/lava_callback.json.gz DEBUG: Setup failed for 69ffeb158d5045ce9472197f. Transitting job node result: incomplete -> fail 2026-05-10 02:38:35,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:38:35,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffeb158d5045ce9472197f HTTP/1.1" 200 None 2026-05-10 02:38:36,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:38:36,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce808d5045ce9471e35c HTTP/1.1" 200 None 2026-05-10 02:38:36,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:38:36,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffeb158d5045ce9472197f HTTP/1.1" 200 None 2026-05-10 02:38:36,115 - lava_callback - INFO - Completed processing callback for node 69ffeb158d5045ce9472197f INFO: 172.20.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43702 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:39:02,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:39:02,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60912 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:43:33,400 - lava_callback - INFO - Received callback for node 69ffec278d5045ce94721a0a INFO: 172.20.0.1:44406 - "POST /node/69ffec278d5045ce94721a0a HTTP/1.0" 202 Accepted 2026-05-10 02:43:33,408 - lava_callback - INFO - Starting async job submit for node 69ffec278d5045ce94721a0a 2026-05-10 02:43:33,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:43:33,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffec278d5045ce94721a0a HTTP/1.1" 200 None 2026-05-10 02:43:33,466 - lava_callback - DEBUG - Processing node 69ffec278d5045ce94721a0a: baseline-nfs-arm64 2026-05-10 02:43:34,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:43:34,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:43:34,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffec278d5045ce94721a0a/log.txt.gz 2026-05-10 02:43:35,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:43:35,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:43:35,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffec278d5045ce94721a0a/lava-logs.yaml 2026-05-10 02:43:35,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-05-10 02:43:35,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-05-10 02:43:35,737 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ffec278d5045ce94721a0a/lava_callback.json.gz DEBUG: Setup failed for 69ffec278d5045ce94721a0a. Transitting job node result: incomplete -> fail 2026-05-10 02:43:35,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:43:35,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffec278d5045ce94721a0a HTTP/1.1" 200 None 2026-05-10 02:43:35,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:43:35,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ffce8d8d5045ce9471e36f HTTP/1.1" 200 None 2026-05-10 02:43:35,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:43:35,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ffec278d5045ce94721a0a HTTP/1.1" 200 None 2026-05-10 02:43:35,979 - lava_callback - INFO - Completed processing callback for node 69ffec278d5045ce94721a0a INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45898 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:44:02,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:44:02,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55864 - "GET /node/6953714031522df6df79dd29%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:48:03,157 - lava_callback - INFO - Received callback for node 69fd4ed7197af08e45fc677d INFO: 172.20.0.1:59792 - "POST /node/69fd4ed7197af08e45fc677d HTTP/1.0" 202 Accepted 2026-05-10 02:48:03,162 - lava_callback - INFO - Starting async job submit for node 69fd4ed7197af08e45fc677d 2026-05-10 02:48:03,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:03,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4ed7197af08e45fc677d HTTP/1.1" 200 None 2026-05-10 02:48:03,179 - lava_callback - DEBUG - Processing node 69fd4ed7197af08e45fc677d: baseline-arm-baylibre 2026-05-10 02:48:03,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4ed7197af08e45fc677d 2026-05-10 02:48:03,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:03,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4ed7197af08e45fc677d HTTP/1.1" 200 None 2026-05-10 02:48:03,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:03,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:48:03,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:03,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4ed7197af08e45fc677d HTTP/1.1" 200 None 2026-05-10 02:48:03,227 - lava_callback - ERROR - Error processing callback for node 69fd4ed7197af08e45fc677d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54844 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:48:43,100 - lava_callback - INFO - Received callback for node 69fd4efb197af08e45fc678b INFO: 172.20.0.1:57228 - "POST /node/69fd4efb197af08e45fc678b HTTP/1.0" 202 Accepted 2026-05-10 02:48:43,106 - lava_callback - INFO - Starting async job submit for node 69fd4efb197af08e45fc678b 2026-05-10 02:48:43,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:43,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4efb197af08e45fc678b HTTP/1.1" 200 None 2026-05-10 02:48:43,125 - lava_callback - DEBUG - Processing node 69fd4efb197af08e45fc678b: baseline-arm-baylibre 2026-05-10 02:48:43,125 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4efb197af08e45fc678b 2026-05-10 02:48:43,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:43,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4efb197af08e45fc678b HTTP/1.1" 200 None 2026-05-10 02:48:43,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:43,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:48:43,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:48:43,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4efb197af08e45fc678b HTTP/1.1" 200 None 2026-05-10 02:48:43,190 - lava_callback - ERROR - Error processing callback for node 69fd4efb197af08e45fc678b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39574 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:49:23,013 - lava_callback - INFO - Received callback for node 69fd4f1f197af08e45fc6796 INFO: 172.20.0.1:39582 - "POST /node/69fd4f1f197af08e45fc6796 HTTP/1.0" 202 Accepted 2026-05-10 02:49:23,019 - lava_callback - INFO - Starting async job submit for node 69fd4f1f197af08e45fc6796 2026-05-10 02:49:23,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f1f197af08e45fc6796 HTTP/1.1" 200 None 2026-05-10 02:49:23,034 - lava_callback - DEBUG - Processing node 69fd4f1f197af08e45fc6796: baseline-arm-baylibre 2026-05-10 02:49:23,034 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4f1f197af08e45fc6796 2026-05-10 02:49:23,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:23,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f1f197af08e45fc6796 HTTP/1.1" 200 None 2026-05-10 02:49:23,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:23,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:49:23,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:23,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4f1f197af08e45fc6796 HTTP/1.1" 200 None 2026-05-10 02:49:23,102 - lava_callback - ERROR - Error processing callback for node 69fd4f1f197af08e45fc6796: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58826 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:49:43,000 - lava_callback - INFO - Received callback for node 69fd4f43197af08e45fc67a0 INFO: 172.20.0.1:37046 - "POST /node/69fd4f43197af08e45fc67a0 HTTP/1.0" 202 Accepted 2026-05-10 02:49:43,007 - lava_callback - INFO - Starting async job submit for node 69fd4f43197af08e45fc67a0 2026-05-10 02:49:43,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:43,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f43197af08e45fc67a0 HTTP/1.1" 200 None 2026-05-10 02:49:43,023 - lava_callback - DEBUG - Processing node 69fd4f43197af08e45fc67a0: baseline-arm-baylibre 2026-05-10 02:49:43,023 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4f43197af08e45fc67a0 2026-05-10 02:49:43,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:43,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f43197af08e45fc67a0 HTTP/1.1" 200 None 2026-05-10 02:49:43,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:43,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:49:43,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:49:43,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4f43197af08e45fc67a0 HTTP/1.1" 200 None 2026-05-10 02:49:43,075 - lava_callback - ERROR - Error processing callback for node 69fd4f43197af08e45fc67a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52556 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:50:23,038 - lava_callback - INFO - Received callback for node 69fd4f69197af08e45fc67b1 INFO: 172.20.0.1:52568 - "POST /node/69fd4f69197af08e45fc67b1 HTTP/1.0" 202 Accepted 2026-05-10 02:50:23,045 - lava_callback - INFO - Starting async job submit for node 69fd4f69197af08e45fc67b1 2026-05-10 02:50:23,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:50:23,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f69197af08e45fc67b1 HTTP/1.1" 200 None 2026-05-10 02:50:23,066 - lava_callback - DEBUG - Processing node 69fd4f69197af08e45fc67b1: baseline-arm-baylibre 2026-05-10 02:50:23,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4f69197af08e45fc67b1 2026-05-10 02:50:23,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:50:23,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f69197af08e45fc67b1 HTTP/1.1" 200 None 2026-05-10 02:50:23,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:50:23,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:50:23,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:50:23,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4f69197af08e45fc67b1 HTTP/1.1" 200 None 2026-05-10 02:50:23,116 - lava_callback - ERROR - Error processing callback for node 69fd4f69197af08e45fc67b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35490 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:51:03,115 - lava_callback - INFO - Received callback for node 69fd4f8d197af08e45fc67bd INFO: 172.20.0.1:51256 - "POST /node/69fd4f8d197af08e45fc67bd HTTP/1.0" 202 Accepted 2026-05-10 02:51:03,123 - lava_callback - INFO - Starting async job submit for node 69fd4f8d197af08e45fc67bd 2026-05-10 02:51:03,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:51:03,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f8d197af08e45fc67bd HTTP/1.1" 200 None 2026-05-10 02:51:03,140 - lava_callback - DEBUG - Processing node 69fd4f8d197af08e45fc67bd: baseline-arm-baylibre 2026-05-10 02:51:03,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4f8d197af08e45fc67bd 2026-05-10 02:51:03,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:51:03,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4f8d197af08e45fc67bd HTTP/1.1" 200 None 2026-05-10 02:51:03,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:51:03,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:51:03,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:51:03,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4f8d197af08e45fc67bd HTTP/1.1" 200 None 2026-05-10 02:51:03,185 - lava_callback - ERROR - Error processing callback for node 69fd4f8d197af08e45fc67bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET /node/6992ebae31166481c8dd9503%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36000 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:52:56,701 - lava_callback - INFO - Received callback for node 69fd4ffb197af08e45fc67ea INFO: 172.20.0.1:36010 - "POST /node/69fd4ffb197af08e45fc67ea HTTP/1.0" 202 Accepted 2026-05-10 02:52:56,707 - lava_callback - INFO - Starting async job submit for node 69fd4ffb197af08e45fc67ea 2026-05-10 02:52:56,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:52:56,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4ffb197af08e45fc67ea HTTP/1.1" 200 None 2026-05-10 02:52:56,722 - lava_callback - DEBUG - Processing node 69fd4ffb197af08e45fc67ea: baseline-arm-clabbe 2026-05-10 02:52:56,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd4ffb197af08e45fc67ea 2026-05-10 02:52:56,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:52:56,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd4ffb197af08e45fc67ea HTTP/1.1" 200 None 2026-05-10 02:52:56,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:52:56,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:52:56,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:52:56,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd4ffb197af08e45fc67ea HTTP/1.1" 200 None 2026-05-10 02:52:56,782 - lava_callback - ERROR - Error processing callback for node 69fd4ffb197af08e45fc67ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55774 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:53:36,640 - lava_callback - INFO - Received callback for node 69fd5021197af08e45fc67f9 INFO: 172.20.0.1:55788 - "POST /node/69fd5021197af08e45fc67f9 HTTP/1.0" 202 Accepted 2026-05-10 02:53:36,645 - lava_callback - INFO - Starting async job submit for node 69fd5021197af08e45fc67f9 2026-05-10 02:53:36,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:53:36,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5021197af08e45fc67f9 HTTP/1.1" 200 None 2026-05-10 02:53:36,660 - lava_callback - DEBUG - Processing node 69fd5021197af08e45fc67f9: baseline-arm-clabbe 2026-05-10 02:53:36,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd5021197af08e45fc67f9 2026-05-10 02:53:36,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:53:36,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5021197af08e45fc67f9 HTTP/1.1" 200 None 2026-05-10 02:53:36,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:53:36,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:53:36,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:53:36,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd5021197af08e45fc67f9 HTTP/1.1" 200 None 2026-05-10 02:53:36,711 - lava_callback - ERROR - Error processing callback for node 69fd5021197af08e45fc67f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47146 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:54:16,696 - lava_callback - INFO - Received callback for node 69fd5046197af08e45fc6805 INFO: 172.20.0.1:47158 - "POST /node/69fd5046197af08e45fc6805 HTTP/1.0" 202 Accepted 2026-05-10 02:54:16,702 - lava_callback - INFO - Starting async job submit for node 69fd5046197af08e45fc6805 2026-05-10 02:54:16,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:16,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5046197af08e45fc6805 HTTP/1.1" 200 None 2026-05-10 02:54:16,723 - lava_callback - DEBUG - Processing node 69fd5046197af08e45fc6805: baseline-arm-clabbe 2026-05-10 02:54:16,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd5046197af08e45fc6805 2026-05-10 02:54:16,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:16,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5046197af08e45fc6805 HTTP/1.1" 200 None 2026-05-10 02:54:16,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:16,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:54:16,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:16,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd5046197af08e45fc6805 HTTP/1.1" 200 None 2026-05-10 02:54:16,771 - lava_callback - ERROR - Error processing callback for node 69fd5046197af08e45fc6805: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:54:56,747 - lava_callback - INFO - Received callback for node 69fd506b197af08e45fc6810 INFO: 172.20.0.1:40778 - "POST /node/69fd506b197af08e45fc6810 HTTP/1.0" 202 Accepted 2026-05-10 02:54:56,753 - lava_callback - INFO - Starting async job submit for node 69fd506b197af08e45fc6810 2026-05-10 02:54:56,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:56,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd506b197af08e45fc6810 HTTP/1.1" 200 None 2026-05-10 02:54:56,769 - lava_callback - DEBUG - Processing node 69fd506b197af08e45fc6810: baseline-arm-clabbe 2026-05-10 02:54:56,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd506b197af08e45fc6810 2026-05-10 02:54:56,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:56,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd506b197af08e45fc6810 HTTP/1.1" 200 None 2026-05-10 02:54:56,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:56,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:54:56,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:54:56,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd506b197af08e45fc6810 HTTP/1.1" 200 None 2026-05-10 02:54:56,826 - lava_callback - ERROR - Error processing callback for node 69fd506b197af08e45fc6810: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41030 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:55:16,766 - lava_callback - INFO - Received callback for node 69fd5091197af08e45fc6821 INFO: 172.20.0.1:41040 - "POST /node/69fd5091197af08e45fc6821 HTTP/1.0" 202 Accepted 2026-05-10 02:55:16,772 - lava_callback - INFO - Starting async job submit for node 69fd5091197af08e45fc6821 2026-05-10 02:55:16,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:16,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5091197af08e45fc6821 HTTP/1.1" 200 None 2026-05-10 02:55:16,788 - lava_callback - DEBUG - Processing node 69fd5091197af08e45fc6821: baseline-arm-clabbe 2026-05-10 02:55:16,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd5091197af08e45fc6821 2026-05-10 02:55:16,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:16,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd5091197af08e45fc6821 HTTP/1.1" 200 None 2026-05-10 02:55:16,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:16,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:55:16,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:16,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd5091197af08e45fc6821 HTTP/1.1" 200 None 2026-05-10 02:55:16,840 - lava_callback - ERROR - Error processing callback for node 69fd5091197af08e45fc6821: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50520 - "GET / HTTP/1.0" 200 OK 2026-05-10 02:55:56,750 - lava_callback - INFO - Received callback for node 69fd50b6197af08e45fc682c INFO: 172.20.0.1:50522 - "POST /node/69fd50b6197af08e45fc682c HTTP/1.0" 202 Accepted 2026-05-10 02:55:56,757 - lava_callback - INFO - Starting async job submit for node 69fd50b6197af08e45fc682c 2026-05-10 02:55:56,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:56,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd50b6197af08e45fc682c HTTP/1.1" 200 None 2026-05-10 02:55:56,772 - lava_callback - DEBUG - Processing node 69fd50b6197af08e45fc682c: baseline-arm-clabbe 2026-05-10 02:55:56,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd50b6197af08e45fc682c 2026-05-10 02:55:56,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:56,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd50b6197af08e45fc682c HTTP/1.1" 200 None 2026-05-10 02:55:56,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:56,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ab955ff273b190b902f HTTP/1.1" 200 None 2026-05-10 02:55:56,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 02:55:56,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd50b6197af08e45fc682c HTTP/1.1" 200 None 2026-05-10 02:55:56,828 - lava_callback - ERROR - Error processing callback for node 69fd50b6197af08e45fc682c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58190 - "GET /node/6825ad57c9b589afbd60e1fb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49046 - "GET /node/6806074f479702f80e8a2187%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59852 - "GET /node/68023b8f3c273fd4e19d4dbb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49748 - "GET /node/67e68186cd7f57c2aced8485%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50552 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:09:27,824 - lava_callback - INFO - Received callback for node 69fd61e5197af08e45fc6995 INFO: 172.20.0.1:50566 - "POST /node/69fd61e5197af08e45fc6995 HTTP/1.0" 202 Accepted 2026-05-10 04:09:27,829 - lava_callback - INFO - Starting async job submit for node 69fd61e5197af08e45fc6995 2026-05-10 04:09:27,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:09:27,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd61e5197af08e45fc6995 HTTP/1.1" 200 None 2026-05-10 04:09:27,844 - lava_callback - DEBUG - Processing node 69fd61e5197af08e45fc6995: baseline-arm64-baylibre 2026-05-10 04:09:27,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd61e5197af08e45fc6995 2026-05-10 04:09:27,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:09:27,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd61e5197af08e45fc6995 HTTP/1.1" 200 None 2026-05-10 04:09:27,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:09:27,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:09:27,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:09:27,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd61e5197af08e45fc6995 HTTP/1.1" 200 None 2026-05-10 04:09:27,888 - lava_callback - ERROR - Error processing callback for node 69fd61e5197af08e45fc6995: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38460 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:13:27,699 - lava_callback - INFO - Received callback for node 69fd62d6197af08e45fc69bd INFO: 172.20.0.1:38468 - "POST /node/69fd62d6197af08e45fc69bd HTTP/1.0" 202 Accepted 2026-05-10 04:13:27,705 - lava_callback - INFO - Starting async job submit for node 69fd62d6197af08e45fc69bd 2026-05-10 04:13:27,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:13:27,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd62d6197af08e45fc69bd HTTP/1.1" 200 None 2026-05-10 04:13:27,720 - lava_callback - DEBUG - Processing node 69fd62d6197af08e45fc69bd: baseline-arm64-baylibre 2026-05-10 04:13:27,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd62d6197af08e45fc69bd 2026-05-10 04:13:27,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:13:27,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd62d6197af08e45fc69bd HTTP/1.1" 200 None 2026-05-10 04:13:27,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:13:27,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:13:27,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:13:27,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd62d6197af08e45fc69bd HTTP/1.1" 200 None 2026-05-10 04:13:27,787 - lava_callback - ERROR - Error processing callback for node 69fd62d6197af08e45fc69bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42980 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:15:00,020 - lava_callback - INFO - Received callback for node 69fd6330197af08e45fc69e3 INFO: 172.20.0.1:51316 - "POST /node/69fd6330197af08e45fc69e3 HTTP/1.0" 202 Accepted 2026-05-10 04:15:00,026 - lava_callback - INFO - Starting async job submit for node 69fd6330197af08e45fc69e3 2026-05-10 04:15:00,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:15:00,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6330197af08e45fc69e3 HTTP/1.1" 200 None 2026-05-10 04:15:00,043 - lava_callback - DEBUG - Processing node 69fd6330197af08e45fc69e3: baseline-arm64-clabbe 2026-05-10 04:15:00,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6330197af08e45fc69e3 2026-05-10 04:15:00,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:15:00,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6330197af08e45fc69e3 HTTP/1.1" 200 None 2026-05-10 04:15:00,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:15:00,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:15:00,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:15:00,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6330197af08e45fc69e3 HTTP/1.1" 200 None 2026-05-10 04:15:00,107 - lava_callback - ERROR - Error processing callback for node 69fd6330197af08e45fc69e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:16:19,963 - lava_callback - INFO - Received callback for node 69fd637e197af08e45fc69fb INFO: 172.20.0.1:55308 - "POST /node/69fd637e197af08e45fc69fb HTTP/1.0" 202 Accepted 2026-05-10 04:16:19,968 - lava_callback - INFO - Starting async job submit for node 69fd637e197af08e45fc69fb 2026-05-10 04:16:19,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:16:19,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd637e197af08e45fc69fb HTTP/1.1" 200 None 2026-05-10 04:16:19,983 - lava_callback - DEBUG - Processing node 69fd637e197af08e45fc69fb: baseline-arm64-clabbe 2026-05-10 04:16:19,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd637e197af08e45fc69fb 2026-05-10 04:16:19,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:16:19,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd637e197af08e45fc69fb HTTP/1.1" 200 None 2026-05-10 04:16:20,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:16:20,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:16:20,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:16:20,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd637e197af08e45fc69fb HTTP/1.1" 200 None 2026-05-10 04:16:20,034 - lava_callback - ERROR - Error processing callback for node 69fd637e197af08e45fc69fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47596 - "GET /node/6966119847bd9cfddf30e060%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:17:39,849 - lava_callback - INFO - Received callback for node 69fd63d1197af08e45fc6a1f INFO: 172.20.0.1:42468 - "POST /node/69fd63d1197af08e45fc6a1f HTTP/1.0" 202 Accepted 2026-05-10 04:17:39,855 - lava_callback - INFO - Starting async job submit for node 69fd63d1197af08e45fc6a1f 2026-05-10 04:17:39,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:17:39,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd63d1197af08e45fc6a1f HTTP/1.1" 200 None 2026-05-10 04:17:39,877 - lava_callback - DEBUG - Processing node 69fd63d1197af08e45fc6a1f: baseline-arm64-clabbe 2026-05-10 04:17:39,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd63d1197af08e45fc6a1f 2026-05-10 04:17:39,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:17:39,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd63d1197af08e45fc6a1f HTTP/1.1" 200 None 2026-05-10 04:17:39,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:17:39,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:17:39,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:17:39,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd63d1197af08e45fc6a1f HTTP/1.1" 200 None 2026-05-10 04:17:39,922 - lava_callback - ERROR - Error processing callback for node 69fd63d1197af08e45fc6a1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39290 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:18:59,966 - lava_callback - INFO - Received callback for node 69fd6429197af08e45fc6a42 INFO: 172.20.0.1:36820 - "POST /node/69fd6429197af08e45fc6a42 HTTP/1.0" 202 Accepted 2026-05-10 04:18:59,974 - lava_callback - INFO - Starting async job submit for node 69fd6429197af08e45fc6a42 2026-05-10 04:18:59,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:18:59,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6429197af08e45fc6a42 HTTP/1.1" 200 None 2026-05-10 04:18:59,996 - lava_callback - DEBUG - Processing node 69fd6429197af08e45fc6a42: baseline-arm64-clabbe 2026-05-10 04:18:59,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6429197af08e45fc6a42 2026-05-10 04:18:59,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:19:00,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6429197af08e45fc6a42 HTTP/1.1" 200 None 2026-05-10 04:19:00,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:19:00,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:19:00,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:19:00,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6429197af08e45fc6a42 HTTP/1.1" 200 None 2026-05-10 04:19:00,058 - lava_callback - ERROR - Error processing callback for node 69fd6429197af08e45fc6a42: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47696 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:20:19,949 - lava_callback - INFO - Received callback for node 69fd6478197af08e45fc6a60 INFO: 172.20.0.1:37752 - "POST /node/69fd6478197af08e45fc6a60 HTTP/1.0" 202 Accepted 2026-05-10 04:20:19,955 - lava_callback - INFO - Starting async job submit for node 69fd6478197af08e45fc6a60 2026-05-10 04:20:19,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:20:19,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6478197af08e45fc6a60 HTTP/1.1" 200 None 2026-05-10 04:20:19,975 - lava_callback - DEBUG - Processing node 69fd6478197af08e45fc6a60: baseline-arm64-clabbe 2026-05-10 04:20:19,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6478197af08e45fc6a60 2026-05-10 04:20:19,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:20:19,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6478197af08e45fc6a60 HTTP/1.1" 200 None 2026-05-10 04:20:19,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:20:20,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:20:20,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:20:20,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6478197af08e45fc6a60 HTTP/1.1" 200 None 2026-05-10 04:20:20,021 - lava_callback - ERROR - Error processing callback for node 69fd6478197af08e45fc6a60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47820 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:21:39,924 - lava_callback - INFO - Received callback for node 69fd64c5197af08e45fc6a84 INFO: 172.20.0.1:47844 - "POST /node/69fd64c5197af08e45fc6a84 HTTP/1.0" 202 Accepted 2026-05-10 04:21:39,930 - lava_callback - INFO - Starting async job submit for node 69fd64c5197af08e45fc6a84 2026-05-10 04:21:39,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:21:39,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd64c5197af08e45fc6a84 HTTP/1.1" 200 None 2026-05-10 04:21:39,944 - lava_callback - DEBUG - Processing node 69fd64c5197af08e45fc6a84: baseline-arm64-clabbe 2026-05-10 04:21:39,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd64c5197af08e45fc6a84 2026-05-10 04:21:39,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:21:39,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd64c5197af08e45fc6a84 HTTP/1.1" 200 None 2026-05-10 04:21:39,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:21:40,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fc4ac655ff273b190b903e HTTP/1.1" 200 None 2026-05-10 04:21:40,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:21:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd64c5197af08e45fc6a84 HTTP/1.1" 200 None 2026-05-10 04:21:40,025 - lava_callback - ERROR - Error processing callback for node 69fd64c5197af08e45fc6a84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46534 - "GET /node/69e5e800ab69ed7ddbbc3946%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:46536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38714 - "GET /node/6992fe3331166481c8ddf3bb%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:40:09,314 - lava_callback - INFO - Received callback for node 69fd6915197af08e45fc6ae0 INFO: 172.20.0.1:60742 - "POST /node/69fd6915197af08e45fc6ae0 HTTP/1.0" 202 Accepted 2026-05-10 04:40:09,320 - lava_callback - INFO - Starting async job submit for node 69fd6915197af08e45fc6ae0 2026-05-10 04:40:09,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:40:09,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6915197af08e45fc6ae0 HTTP/1.1" 200 None 2026-05-10 04:40:09,336 - lava_callback - DEBUG - Processing node 69fd6915197af08e45fc6ae0: baseline-arm-baylibre 2026-05-10 04:40:09,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6915197af08e45fc6ae0 2026-05-10 04:40:09,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:40:09,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6915197af08e45fc6ae0 HTTP/1.1" 200 None 2026-05-10 04:40:09,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:40:09,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbb900c2e97cda07f0416 HTTP/1.1" 200 None 2026-05-10 04:40:09,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:40:09,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6915197af08e45fc6ae0 HTTP/1.1" 200 None 2026-05-10 04:40:09,384 - lava_callback - ERROR - Error processing callback for node 69fd6915197af08e45fc6ae0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48914 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:44:20,726 - lava_callback - INFO - Received callback for node 69fd6a21197af08e45fc6b0e INFO: 172.20.0.1:46538 - "POST /node/69fd6a21197af08e45fc6b0e HTTP/1.0" 202 Accepted 2026-05-10 04:44:20,732 - lava_callback - INFO - Starting async job submit for node 69fd6a21197af08e45fc6b0e 2026-05-10 04:44:20,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:44:20,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a21197af08e45fc6b0e HTTP/1.1" 200 None 2026-05-10 04:44:20,747 - lava_callback - DEBUG - Processing node 69fd6a21197af08e45fc6b0e: baseline-arm-clabbe 2026-05-10 04:44:20,747 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6a21197af08e45fc6b0e 2026-05-10 04:44:20,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:44:20,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a21197af08e45fc6b0e HTTP/1.1" 200 None 2026-05-10 04:44:20,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:44:20,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbb900c2e97cda07f0416 HTTP/1.1" 200 None 2026-05-10 04:44:20,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:44:20,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6a21197af08e45fc6b0e HTTP/1.1" 200 None 2026-05-10 04:44:20,797 - lava_callback - ERROR - Error processing callback for node 69fd6a21197af08e45fc6b0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57462 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:45:00,719 - lava_callback - INFO - Received callback for node 69fd6a47197af08e45fc6b17 INFO: 172.20.0.1:36194 - "POST /node/69fd6a47197af08e45fc6b17 HTTP/1.0" 202 Accepted 2026-05-10 04:45:00,728 - lava_callback - INFO - Starting async job submit for node 69fd6a47197af08e45fc6b17 2026-05-10 04:45:00,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:00,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a47197af08e45fc6b17 HTTP/1.1" 200 None 2026-05-10 04:45:00,744 - lava_callback - DEBUG - Processing node 69fd6a47197af08e45fc6b17: baseline-arm-clabbe 2026-05-10 04:45:00,745 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6a47197af08e45fc6b17 2026-05-10 04:45:00,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:00,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a47197af08e45fc6b17 HTTP/1.1" 200 None 2026-05-10 04:45:00,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:00,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbb900c2e97cda07f0416 HTTP/1.1" 200 None 2026-05-10 04:45:00,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:00,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6a47197af08e45fc6b17 HTTP/1.1" 200 None 2026-05-10 04:45:00,799 - lava_callback - ERROR - Error processing callback for node 69fd6a47197af08e45fc6b17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35066 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:45:40,844 - lava_callback - INFO - Received callback for node 69fd6a6d197af08e45fc6b25 INFO: 172.20.0.1:33464 - "POST /node/69fd6a6d197af08e45fc6b25 HTTP/1.0" 202 Accepted 2026-05-10 04:45:40,850 - lava_callback - INFO - Starting async job submit for node 69fd6a6d197af08e45fc6b25 2026-05-10 04:45:40,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:40,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a6d197af08e45fc6b25 HTTP/1.1" 200 None 2026-05-10 04:45:40,864 - lava_callback - DEBUG - Processing node 69fd6a6d197af08e45fc6b25: baseline-arm-clabbe 2026-05-10 04:45:40,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6a6d197af08e45fc6b25 2026-05-10 04:45:40,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:40,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a6d197af08e45fc6b25 HTTP/1.1" 200 None 2026-05-10 04:45:40,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:40,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbb900c2e97cda07f0416 HTTP/1.1" 200 None 2026-05-10 04:45:40,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:45:40,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6a6d197af08e45fc6b25 HTTP/1.1" 200 None 2026-05-10 04:45:40,912 - lava_callback - ERROR - Error processing callback for node 69fd6a6d197af08e45fc6b25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33304 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:46:20,815 - lava_callback - INFO - Received callback for node 69fd6a94197af08e45fc6b39 INFO: 172.20.0.1:50576 - "POST /node/69fd6a94197af08e45fc6b39 HTTP/1.0" 202 Accepted 2026-05-10 04:46:20,821 - lava_callback - INFO - Starting async job submit for node 69fd6a94197af08e45fc6b39 2026-05-10 04:46:20,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:46:20,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a94197af08e45fc6b39 HTTP/1.1" 200 None 2026-05-10 04:46:20,836 - lava_callback - DEBUG - Processing node 69fd6a94197af08e45fc6b39: baseline-arm-clabbe 2026-05-10 04:46:20,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6a94197af08e45fc6b39 2026-05-10 04:46:20,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:46:20,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6a94197af08e45fc6b39 HTTP/1.1" 200 None 2026-05-10 04:46:20,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:46:20,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbb900c2e97cda07f0416 HTTP/1.1" 200 None 2026-05-10 04:46:20,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:46:20,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6a94197af08e45fc6b39 HTTP/1.1" 200 None 2026-05-10 04:46:20,882 - lava_callback - ERROR - Error processing callback for node 69fd6a94197af08e45fc6b39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52232 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:47:00,739 - lava_callback - INFO - Received callback for node 69fd6ab9197af08e45fc6b41 INFO: 172.20.0.1:38566 - "POST /node/69fd6ab9197af08e45fc6b41 HTTP/1.0" 202 Accepted 2026-05-10 04:47:00,744 - lava_callback - INFO - Starting async job submit for node 69fd6ab9197af08e45fc6b41 2026-05-10 04:47:00,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:00,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6ab9197af08e45fc6b41 HTTP/1.1" 200 None 2026-05-10 04:47:00,759 - lava_callback - DEBUG - Processing node 69fd6ab9197af08e45fc6b41: baseline-arm-clabbe 2026-05-10 04:47:00,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6ab9197af08e45fc6b41 2026-05-10 04:47:00,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:00,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6ab9197af08e45fc6b41 HTTP/1.1" 200 None 2026-05-10 04:47:00,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:00,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbb900c2e97cda07f0416 HTTP/1.1" 200 None 2026-05-10 04:47:00,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:00,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6ab9197af08e45fc6b41 HTTP/1.1" 200 None 2026-05-10 04:47:00,811 - lava_callback - ERROR - Error processing callback for node 69fd6ab9197af08e45fc6b41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:47:40,853 - lava_callback - INFO - Received callback for node 69fd6adf197af08e45fc6b52 INFO: 172.20.0.1:39684 - "POST /node/69fd6adf197af08e45fc6b52 HTTP/1.0" 202 Accepted 2026-05-10 04:47:40,858 - lava_callback - INFO - Starting async job submit for node 69fd6adf197af08e45fc6b52 2026-05-10 04:47:40,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:40,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6adf197af08e45fc6b52 HTTP/1.1" 200 None 2026-05-10 04:47:40,873 - lava_callback - DEBUG - Processing node 69fd6adf197af08e45fc6b52: baseline-arm-clabbe 2026-05-10 04:47:40,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6adf197af08e45fc6b52 2026-05-10 04:47:40,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:40,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6adf197af08e45fc6b52 HTTP/1.1" 200 None 2026-05-10 04:47:40,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:40,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbb900c2e97cda07f0416 HTTP/1.1" 200 None 2026-05-10 04:47:40,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:47:40,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6adf197af08e45fc6b52 HTTP/1.1" 200 None 2026-05-10 04:47:40,927 - lava_callback - ERROR - Error processing callback for node 69fd6adf197af08e45fc6b52: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47026 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:54:29,923 - lava_callback - INFO - Received callback for node 69fd6c77197af08e45fc6bf7 INFO: 172.20.0.1:49534 - "POST /node/69fd6c77197af08e45fc6bf7 HTTP/1.0" 202 Accepted 2026-05-10 04:54:29,929 - lava_callback - INFO - Starting async job submit for node 69fd6c77197af08e45fc6bf7 2026-05-10 04:54:29,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:54:29,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6c77197af08e45fc6bf7 HTTP/1.1" 200 None 2026-05-10 04:54:29,943 - lava_callback - DEBUG - Processing node 69fd6c77197af08e45fc6bf7: baseline-arm64-baylibre 2026-05-10 04:54:29,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6c77197af08e45fc6bf7 2026-05-10 04:54:29,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:54:29,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6c77197af08e45fc6bf7 HTTP/1.1" 200 None 2026-05-10 04:54:29,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:54:29,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 04:54:29,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:54:29,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6c77197af08e45fc6bf7 HTTP/1.1" 200 None 2026-05-10 04:54:29,996 - lava_callback - ERROR - Error processing callback for node 69fd6c77197af08e45fc6bf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55570 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:55:50,006 - lava_callback - INFO - Received callback for node 69fd6cc3197af08e45fc6c19 INFO: 172.20.0.1:47576 - "POST /node/69fd6cc3197af08e45fc6c19 HTTP/1.0" 202 Accepted 2026-05-10 04:55:50,012 - lava_callback - INFO - Starting async job submit for node 69fd6cc3197af08e45fc6c19 2026-05-10 04:55:50,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:55:50,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6cc3197af08e45fc6c19 HTTP/1.1" 200 None 2026-05-10 04:55:50,069 - lava_callback - DEBUG - Processing node 69fd6cc3197af08e45fc6c19: baseline-arm64-baylibre 2026-05-10 04:55:50,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6cc3197af08e45fc6c19 2026-05-10 04:55:50,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:55:50,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6cc3197af08e45fc6c19 HTTP/1.1" 200 None 2026-05-10 04:55:50,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:55:50,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 04:55:50,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:55:50,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6cc3197af08e45fc6c19 HTTP/1.1" 200 None 2026-05-10 04:55:50,236 - lava_callback - ERROR - Error processing callback for node 69fd6cc3197af08e45fc6c19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47082 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:56:50,014 - lava_callback - INFO - Received callback for node 69fd6d0d197af08e45fc6c3e INFO: 172.20.0.1:48144 - "POST /node/69fd6d0d197af08e45fc6c3e HTTP/1.0" 202 Accepted 2026-05-10 04:56:50,020 - lava_callback - INFO - Starting async job submit for node 69fd6d0d197af08e45fc6c3e 2026-05-10 04:56:50,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:56:50,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6d0d197af08e45fc6c3e HTTP/1.1" 200 None 2026-05-10 04:56:50,036 - lava_callback - DEBUG - Processing node 69fd6d0d197af08e45fc6c3e: baseline-arm64-baylibre 2026-05-10 04:56:50,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6d0d197af08e45fc6c3e 2026-05-10 04:56:50,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:56:50,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6d0d197af08e45fc6c3e HTTP/1.1" 200 None 2026-05-10 04:56:50,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:56:50,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 04:56:50,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:56:50,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6d0d197af08e45fc6c3e HTTP/1.1" 200 None 2026-05-10 04:56:50,093 - lava_callback - ERROR - Error processing callback for node 69fd6d0d197af08e45fc6c3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54074 - "GET / HTTP/1.0" 200 OK 2026-05-10 04:59:30,160 - lava_callback - INFO - Received callback for node 69fd6da4197af08e45fc6c83 INFO: 172.20.0.1:57362 - "POST /node/69fd6da4197af08e45fc6c83 HTTP/1.0" 202 Accepted 2026-05-10 04:59:30,168 - lava_callback - INFO - Starting async job submit for node 69fd6da4197af08e45fc6c83 2026-05-10 04:59:30,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:59:30,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6da4197af08e45fc6c83 HTTP/1.1" 200 None 2026-05-10 04:59:30,183 - lava_callback - DEBUG - Processing node 69fd6da4197af08e45fc6c83: baseline-arm64-baylibre 2026-05-10 04:59:30,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6da4197af08e45fc6c83 2026-05-10 04:59:30,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:59:30,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6da4197af08e45fc6c83 HTTP/1.1" 200 None 2026-05-10 04:59:30,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:59:30,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 04:59:30,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 04:59:30,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6da4197af08e45fc6c83 HTTP/1.1" 200 None 2026-05-10 04:59:30,236 - lava_callback - ERROR - Error processing callback for node 69fd6da4197af08e45fc6c83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36566 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:00:50,312 - lava_callback - INFO - Received callback for node 69fd6def197af08e45fc6ca5 INFO: 172.20.0.1:57450 - "POST /node/69fd6def197af08e45fc6ca5 HTTP/1.0" 202 Accepted 2026-05-10 05:00:50,318 - lava_callback - INFO - Starting async job submit for node 69fd6def197af08e45fc6ca5 2026-05-10 05:00:50,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:00:50,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6def197af08e45fc6ca5 HTTP/1.1" 200 None 2026-05-10 05:00:50,337 - lava_callback - DEBUG - Processing node 69fd6def197af08e45fc6ca5: baseline-arm64-baylibre 2026-05-10 05:00:50,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6def197af08e45fc6ca5 2026-05-10 05:00:50,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:00:50,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6def197af08e45fc6ca5 HTTP/1.1" 200 None 2026-05-10 05:00:50,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:00:50,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:00:50,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:00:50,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6def197af08e45fc6ca5 HTTP/1.1" 200 None 2026-05-10 05:00:50,396 - lava_callback - ERROR - Error processing callback for node 69fd6def197af08e45fc6ca5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55406 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:01:50,265 - lava_callback - INFO - Received callback for node 69fd6e3b197af08e45fc6ccc INFO: 172.20.0.1:35720 - "POST /node/69fd6e3b197af08e45fc6ccc HTTP/1.0" 202 Accepted 2026-05-10 05:01:50,270 - lava_callback - INFO - Starting async job submit for node 69fd6e3b197af08e45fc6ccc 2026-05-10 05:01:50,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:01:50,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6e3b197af08e45fc6ccc HTTP/1.1" 200 None 2026-05-10 05:01:50,292 - lava_callback - DEBUG - Processing node 69fd6e3b197af08e45fc6ccc: baseline-arm64-baylibre 2026-05-10 05:01:50,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6e3b197af08e45fc6ccc 2026-05-10 05:01:50,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:01:50,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6e3b197af08e45fc6ccc HTTP/1.1" 200 None 2026-05-10 05:01:50,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:01:50,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:01:50,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:01:50,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6e3b197af08e45fc6ccc HTTP/1.1" 200 None 2026-05-10 05:01:50,338 - lava_callback - ERROR - Error processing callback for node 69fd6e3b197af08e45fc6ccc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52714 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:03:10,387 - lava_callback - INFO - Received callback for node 69fd6e87197af08e45fc6cef INFO: 172.20.0.1:57760 - "POST /node/69fd6e87197af08e45fc6cef HTTP/1.0" 202 Accepted 2026-05-10 05:03:10,393 - lava_callback - INFO - Starting async job submit for node 69fd6e87197af08e45fc6cef 2026-05-10 05:03:10,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:03:10,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6e87197af08e45fc6cef HTTP/1.1" 200 None 2026-05-10 05:03:10,408 - lava_callback - DEBUG - Processing node 69fd6e87197af08e45fc6cef: baseline-arm64-baylibre 2026-05-10 05:03:10,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6e87197af08e45fc6cef 2026-05-10 05:03:10,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:03:10,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6e87197af08e45fc6cef HTTP/1.1" 200 None 2026-05-10 05:03:10,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:03:10,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:03:10,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:03:10,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6e87197af08e45fc6cef HTTP/1.1" 200 None 2026-05-10 05:03:10,454 - lava_callback - ERROR - Error processing callback for node 69fd6e87197af08e45fc6cef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36290 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:04:30,475 - lava_callback - INFO - Received callback for node 69fd6ed3197af08e45fc6d16 INFO: 172.20.0.1:56158 - "POST /node/69fd6ed3197af08e45fc6d16 HTTP/1.0" 202 Accepted 2026-05-10 05:04:30,481 - lava_callback - INFO - Starting async job submit for node 69fd6ed3197af08e45fc6d16 2026-05-10 05:04:30,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:04:30,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6ed3197af08e45fc6d16 HTTP/1.1" 200 None 2026-05-10 05:04:30,495 - lava_callback - DEBUG - Processing node 69fd6ed3197af08e45fc6d16: baseline-arm64-baylibre 2026-05-10 05:04:30,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6ed3197af08e45fc6d16 2026-05-10 05:04:30,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:04:30,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6ed3197af08e45fc6d16 HTTP/1.1" 200 None 2026-05-10 05:04:30,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:04:30,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:04:30,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:04:30,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6ed3197af08e45fc6d16 HTTP/1.1" 200 None 2026-05-10 05:04:30,547 - lava_callback - ERROR - Error processing callback for node 69fd6ed3197af08e45fc6d16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34042 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:05:50,552 - lava_callback - INFO - Received callback for node 69fd6f1f197af08e45fc6d39 INFO: 172.20.0.1:60202 - "POST /node/69fd6f1f197af08e45fc6d39 HTTP/1.0" 202 Accepted 2026-05-10 05:05:50,558 - lava_callback - INFO - Starting async job submit for node 69fd6f1f197af08e45fc6d39 2026-05-10 05:05:50,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:05:50,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6f1f197af08e45fc6d39 HTTP/1.1" 200 None 2026-05-10 05:05:50,589 - lava_callback - DEBUG - Processing node 69fd6f1f197af08e45fc6d39: baseline-arm64-baylibre 2026-05-10 05:05:50,589 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6f1f197af08e45fc6d39 2026-05-10 05:05:50,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:05:50,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6f1f197af08e45fc6d39 HTTP/1.1" 200 None 2026-05-10 05:05:50,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:05:50,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:05:50,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:05:50,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6f1f197af08e45fc6d39 HTTP/1.1" 200 None 2026-05-10 05:05:50,653 - lava_callback - ERROR - Error processing callback for node 69fd6f1f197af08e45fc6d39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52066 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:07:10,659 - lava_callback - INFO - Received callback for node 69fd6f6c197af08e45fc6d62 INFO: 172.20.0.1:50228 - "POST /node/69fd6f6c197af08e45fc6d62 HTTP/1.0" 202 Accepted 2026-05-10 05:07:10,664 - lava_callback - INFO - Starting async job submit for node 69fd6f6c197af08e45fc6d62 2026-05-10 05:07:10,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:07:10,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6f6c197af08e45fc6d62 HTTP/1.1" 200 None 2026-05-10 05:07:10,680 - lava_callback - DEBUG - Processing node 69fd6f6c197af08e45fc6d62: baseline-arm64-baylibre 2026-05-10 05:07:10,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6f6c197af08e45fc6d62 2026-05-10 05:07:10,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:07:10,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6f6c197af08e45fc6d62 HTTP/1.1" 200 None 2026-05-10 05:07:10,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:07:10,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:07:10,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:07:10,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6f6c197af08e45fc6d62 HTTP/1.1" 200 None 2026-05-10 05:07:10,761 - lava_callback - ERROR - Error processing callback for node 69fd6f6c197af08e45fc6d62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42388 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:08:21,690 - lava_callback - INFO - Received callback for node 69fd6fbb197af08e45fc6d86 INFO: 172.20.0.1:43228 - "POST /node/69fd6fbb197af08e45fc6d86 HTTP/1.0" 202 Accepted 2026-05-10 05:08:21,696 - lava_callback - INFO - Starting async job submit for node 69fd6fbb197af08e45fc6d86 2026-05-10 05:08:21,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:08:21,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6fbb197af08e45fc6d86 HTTP/1.1" 200 None 2026-05-10 05:08:21,711 - lava_callback - DEBUG - Processing node 69fd6fbb197af08e45fc6d86: baseline-arm64-clabbe 2026-05-10 05:08:21,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd6fbb197af08e45fc6d86 2026-05-10 05:08:21,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:08:21,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd6fbb197af08e45fc6d86 HTTP/1.1" 200 None 2026-05-10 05:08:21,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:08:21,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:08:21,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:08:21,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd6fbb197af08e45fc6d86 HTTP/1.1" 200 None 2026-05-10 05:08:21,756 - lava_callback - ERROR - Error processing callback for node 69fd6fbb197af08e45fc6d86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52424 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:09:41,713 - lava_callback - INFO - Received callback for node 69fd7009197af08e45fc6dac INFO: 172.20.0.1:55546 - "POST /node/69fd7009197af08e45fc6dac HTTP/1.0" 202 Accepted 2026-05-10 05:09:41,719 - lava_callback - INFO - Starting async job submit for node 69fd7009197af08e45fc6dac 2026-05-10 05:09:41,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:09:41,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7009197af08e45fc6dac HTTP/1.1" 200 None 2026-05-10 05:09:41,735 - lava_callback - DEBUG - Processing node 69fd7009197af08e45fc6dac: baseline-arm64-clabbe 2026-05-10 05:09:41,735 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7009197af08e45fc6dac 2026-05-10 05:09:41,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:09:41,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7009197af08e45fc6dac HTTP/1.1" 200 None 2026-05-10 05:09:41,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:09:41,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:09:41,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:09:41,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7009197af08e45fc6dac HTTP/1.1" 200 None 2026-05-10 05:09:41,808 - lava_callback - ERROR - Error processing callback for node 69fd7009197af08e45fc6dac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53080 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:10:50,895 - lava_callback - INFO - Received callback for node 69fd704f197af08e45fc6dcd INFO: 172.20.0.1:43626 - "POST /node/69fd704f197af08e45fc6dcd HTTP/1.0" 202 Accepted 2026-05-10 05:10:50,901 - lava_callback - INFO - Starting async job submit for node 69fd704f197af08e45fc6dcd 2026-05-10 05:10:50,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:10:50,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd704f197af08e45fc6dcd HTTP/1.1" 200 None 2026-05-10 05:10:50,916 - lava_callback - DEBUG - Processing node 69fd704f197af08e45fc6dcd: baseline-arm64-baylibre 2026-05-10 05:10:50,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd704f197af08e45fc6dcd 2026-05-10 05:10:50,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:10:50,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd704f197af08e45fc6dcd HTTP/1.1" 200 None 2026-05-10 05:10:50,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:10:50,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:10:50,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:10:50,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd704f197af08e45fc6dcd HTTP/1.1" 200 None 2026-05-10 05:10:50,975 - lava_callback - ERROR - Error processing callback for node 69fd704f197af08e45fc6dcd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55018 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:12:21,871 - lava_callback - INFO - Received callback for node 69fd709f197af08e45fc6df7 INFO: 172.20.0.1:37734 - "POST /node/69fd709f197af08e45fc6df7 HTTP/1.0" 202 Accepted 2026-05-10 05:12:21,877 - lava_callback - INFO - Starting async job submit for node 69fd709f197af08e45fc6df7 2026-05-10 05:12:21,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:12:21,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd709f197af08e45fc6df7 HTTP/1.1" 200 None 2026-05-10 05:12:21,910 - lava_callback - DEBUG - Processing node 69fd709f197af08e45fc6df7: baseline-arm64-clabbe 2026-05-10 05:12:21,910 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd709f197af08e45fc6df7 2026-05-10 05:12:21,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:12:21,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd709f197af08e45fc6df7 HTTP/1.1" 200 None 2026-05-10 05:12:21,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:12:21,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:12:21,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:12:21,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd709f197af08e45fc6df7 HTTP/1.1" 200 None 2026-05-10 05:12:21,974 - lava_callback - ERROR - Error processing callback for node 69fd709f197af08e45fc6df7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36316 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:13:21,862 - lava_callback - INFO - Received callback for node 69fd70e9197af08e45fc6e2a INFO: 172.20.0.1:59956 - "POST /node/69fd70e9197af08e45fc6e2a HTTP/1.0" 202 Accepted 2026-05-10 05:13:21,868 - lava_callback - INFO - Starting async job submit for node 69fd70e9197af08e45fc6e2a 2026-05-10 05:13:21,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:13:21,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd70e9197af08e45fc6e2a HTTP/1.1" 200 None 2026-05-10 05:13:21,885 - lava_callback - DEBUG - Processing node 69fd70e9197af08e45fc6e2a: baseline-arm64-clabbe 2026-05-10 05:13:21,885 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd70e9197af08e45fc6e2a 2026-05-10 05:13:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:13:21,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd70e9197af08e45fc6e2a HTTP/1.1" 200 None 2026-05-10 05:13:21,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:13:21,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:13:21,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:13:21,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd70e9197af08e45fc6e2a HTTP/1.1" 200 None 2026-05-10 05:13:21,942 - lava_callback - ERROR - Error processing callback for node 69fd70e9197af08e45fc6e2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44304 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:14:41,941 - lava_callback - INFO - Received callback for node 69fd7134197af08e45fc6e43 INFO: 172.20.0.1:46616 - "POST /node/69fd7134197af08e45fc6e43 HTTP/1.0" 202 Accepted 2026-05-10 05:14:41,947 - lava_callback - INFO - Starting async job submit for node 69fd7134197af08e45fc6e43 2026-05-10 05:14:41,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:14:41,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7134197af08e45fc6e43 HTTP/1.1" 200 None 2026-05-10 05:14:41,962 - lava_callback - DEBUG - Processing node 69fd7134197af08e45fc6e43: baseline-arm64-clabbe 2026-05-10 05:14:41,963 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7134197af08e45fc6e43 2026-05-10 05:14:41,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:14:41,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7134197af08e45fc6e43 HTTP/1.1" 200 None 2026-05-10 05:14:41,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:14:41,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:14:42,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:14:42,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7134197af08e45fc6e43 HTTP/1.1" 200 None 2026-05-10 05:14:42,018 - lava_callback - ERROR - Error processing callback for node 69fd7134197af08e45fc6e43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56206 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:16:02,256 - lava_callback - INFO - Received callback for node 69fd717f197af08e45fc6e74 INFO: 172.20.0.1:48836 - "POST /node/69fd717f197af08e45fc6e74 HTTP/1.0" 202 Accepted 2026-05-10 05:16:02,262 - lava_callback - INFO - Starting async job submit for node 69fd717f197af08e45fc6e74 2026-05-10 05:16:02,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:16:02,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd717f197af08e45fc6e74 HTTP/1.1" 200 None 2026-05-10 05:16:02,277 - lava_callback - DEBUG - Processing node 69fd717f197af08e45fc6e74: baseline-arm64-clabbe 2026-05-10 05:16:02,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd717f197af08e45fc6e74 2026-05-10 05:16:02,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:16:02,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd717f197af08e45fc6e74 HTTP/1.1" 200 None 2026-05-10 05:16:02,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:16:02,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:16:02,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:16:02,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd717f197af08e45fc6e74 HTTP/1.1" 200 None 2026-05-10 05:16:02,324 - lava_callback - ERROR - Error processing callback for node 69fd717f197af08e45fc6e74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41776 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:17:02,125 - lava_callback - INFO - Received callback for node 69fd71ca197af08e45fc6e8d INFO: 172.20.0.1:41560 - "POST /node/69fd71ca197af08e45fc6e8d HTTP/1.0" 202 Accepted 2026-05-10 05:17:02,131 - lava_callback - INFO - Starting async job submit for node 69fd71ca197af08e45fc6e8d 2026-05-10 05:17:02,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:17:02,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd71ca197af08e45fc6e8d HTTP/1.1" 200 None 2026-05-10 05:17:02,146 - lava_callback - DEBUG - Processing node 69fd71ca197af08e45fc6e8d: baseline-arm64-clabbe 2026-05-10 05:17:02,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd71ca197af08e45fc6e8d 2026-05-10 05:17:02,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:17:02,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd71ca197af08e45fc6e8d HTTP/1.1" 200 None 2026-05-10 05:17:02,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:17:02,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fcbba10c2e97cda07f0428 HTTP/1.1" 200 None 2026-05-10 05:17:02,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:17:02,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd71ca197af08e45fc6e8d HTTP/1.1" 200 None 2026-05-10 05:17:02,196 - lava_callback - ERROR - Error processing callback for node 69fd71ca197af08e45fc6e8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:18:22,125 - lava_callback - INFO - Received callback for node 69fd7216197af08e45fc6eba INFO: 172.20.0.1:42958 - "POST /node/69fd7216197af08e45fc6eba HTTP/1.0" 202 Accepted 2026-05-10 05:18:22,130 - lava_callback - INFO - Starting async job submit for node 69fd7216197af08e45fc6eba 2026-05-10 05:18:22,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:18:22,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7216197af08e45fc6eba HTTP/1.1" 200 None 2026-05-10 05:18:22,152 - lava_callback - DEBUG - Processing node 69fd7216197af08e45fc6eba: baseline-arm64-clabbe 2026-05-10 05:18:22,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7216197af08e45fc6eba 2026-05-10 05:18:22,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:18:22,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7216197af08e45fc6eba HTTP/1.1" 200 None 2026-05-10 05:18:22,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:18:22,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:18:22,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:18:22,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7216197af08e45fc6eba HTTP/1.1" 200 None 2026-05-10 05:18:22,210 - lava_callback - ERROR - Error processing callback for node 69fd7216197af08e45fc6eba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43246 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:19:42,210 - lava_callback - INFO - Received callback for node 69fd7262197af08e45fc6ed2 INFO: 172.20.0.1:57914 - "POST /node/69fd7262197af08e45fc6ed2 HTTP/1.0" 202 Accepted 2026-05-10 05:19:42,216 - lava_callback - INFO - Starting async job submit for node 69fd7262197af08e45fc6ed2 2026-05-10 05:19:42,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:19:42,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7262197af08e45fc6ed2 HTTP/1.1" 200 None 2026-05-10 05:19:42,232 - lava_callback - DEBUG - Processing node 69fd7262197af08e45fc6ed2: baseline-arm64-clabbe 2026-05-10 05:19:42,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7262197af08e45fc6ed2 2026-05-10 05:19:42,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:19:42,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7262197af08e45fc6ed2 HTTP/1.1" 200 None 2026-05-10 05:19:42,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:19:42,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:19:42,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:19:42,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7262197af08e45fc6ed2 HTTP/1.1" 200 None 2026-05-10 05:19:42,279 - lava_callback - ERROR - Error processing callback for node 69fd7262197af08e45fc6ed2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47652 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:23:22,383 - lava_callback - INFO - Received callback for node 69fd7342197af08e45fc6f4e INFO: 172.20.0.1:46726 - "POST /node/69fd7342197af08e45fc6f4e HTTP/1.0" 202 Accepted 2026-05-10 05:23:22,389 - lava_callback - INFO - Starting async job submit for node 69fd7342197af08e45fc6f4e 2026-05-10 05:23:22,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:23:22,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7342197af08e45fc6f4e HTTP/1.1" 200 None 2026-05-10 05:23:22,409 - lava_callback - DEBUG - Processing node 69fd7342197af08e45fc6f4e: baseline-arm64-clabbe 2026-05-10 05:23:22,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7342197af08e45fc6f4e 2026-05-10 05:23:22,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:23:22,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7342197af08e45fc6f4e HTTP/1.1" 200 None 2026-05-10 05:23:22,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:23:22,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:23:22,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:23:22,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7342197af08e45fc6f4e HTTP/1.1" 200 None 2026-05-10 05:23:22,456 - lava_callback - ERROR - Error processing callback for node 69fd7342197af08e45fc6f4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:27:02,575 - lava_callback - INFO - Received callback for node 69fd7423197af08e45fc6fb3 INFO: 172.20.0.1:56324 - "POST /node/69fd7423197af08e45fc6fb3 HTTP/1.0" 202 Accepted 2026-05-10 05:27:02,581 - lava_callback - INFO - Starting async job submit for node 69fd7423197af08e45fc6fb3 2026-05-10 05:27:02,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:27:02,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7423197af08e45fc6fb3 HTTP/1.1" 200 None 2026-05-10 05:27:02,595 - lava_callback - DEBUG - Processing node 69fd7423197af08e45fc6fb3: baseline-arm64-clabbe 2026-05-10 05:27:02,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7423197af08e45fc6fb3 2026-05-10 05:27:02,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:27:02,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7423197af08e45fc6fb3 HTTP/1.1" 200 None 2026-05-10 05:27:02,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:27:02,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:27:02,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:27:02,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7423197af08e45fc6fb3 HTTP/1.1" 200 None 2026-05-10 05:27:02,673 - lava_callback - ERROR - Error processing callback for node 69fd7423197af08e45fc6fb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50916 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:28:22,626 - lava_callback - INFO - Received callback for node 69fd7471197af08e45fc6fe3 INFO: 172.20.0.1:37352 - "POST /node/69fd7471197af08e45fc6fe3 HTTP/1.0" 202 Accepted 2026-05-10 05:28:22,633 - lava_callback - INFO - Starting async job submit for node 69fd7471197af08e45fc6fe3 2026-05-10 05:28:22,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:28:22,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7471197af08e45fc6fe3 HTTP/1.1" 200 None 2026-05-10 05:28:22,650 - lava_callback - DEBUG - Processing node 69fd7471197af08e45fc6fe3: baseline-arm64-clabbe 2026-05-10 05:28:22,650 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7471197af08e45fc6fe3 2026-05-10 05:28:22,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:28:22,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7471197af08e45fc6fe3 HTTP/1.1" 200 None 2026-05-10 05:28:22,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:28:22,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:28:22,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:28:22,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7471197af08e45fc6fe3 HTTP/1.1" 200 None 2026-05-10 05:28:22,727 - lava_callback - ERROR - Error processing callback for node 69fd7471197af08e45fc6fe3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40848 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:29:31,935 - lava_callback - INFO - Received callback for node 69fd74b7197af08e45fc7000 INFO: 172.20.0.1:43924 - "POST /node/69fd74b7197af08e45fc7000 HTTP/1.0" 202 Accepted 2026-05-10 05:29:31,941 - lava_callback - INFO - Starting async job submit for node 69fd74b7197af08e45fc7000 2026-05-10 05:29:31,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:29:31,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd74b7197af08e45fc7000 HTTP/1.1" 200 None 2026-05-10 05:29:31,955 - lava_callback - DEBUG - Processing node 69fd74b7197af08e45fc7000: baseline-arm64-baylibre 2026-05-10 05:29:31,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd74b7197af08e45fc7000 2026-05-10 05:29:31,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:29:31,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd74b7197af08e45fc7000 HTTP/1.1" 200 None 2026-05-10 05:29:31,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:29:31,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:29:31,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:29:32,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd74b7197af08e45fc7000 HTTP/1.1" 200 None 2026-05-10 05:29:32,006 - lava_callback - ERROR - Error processing callback for node 69fd74b7197af08e45fc7000: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53906 - "GET /node/6992ebb431166481c8dd9516%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:38318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46078 - "GET /node/68f8959b1f469265150784dc%5Cn HTTP/1.0" 405 Method Not Allowed 2026-05-10 05:30:52,025 - lava_callback - INFO - Received callback for node 69fd7503197af08e45fc7031 INFO: 172.20.0.1:46086 - "POST /node/69fd7503197af08e45fc7031 HTTP/1.0" 202 Accepted 2026-05-10 05:30:52,031 - lava_callback - INFO - Starting async job submit for node 69fd7503197af08e45fc7031 2026-05-10 05:30:52,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:30:52,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7503197af08e45fc7031 HTTP/1.1" 200 None 2026-05-10 05:30:52,046 - lava_callback - DEBUG - Processing node 69fd7503197af08e45fc7031: baseline-arm64-baylibre 2026-05-10 05:30:52,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7503197af08e45fc7031 2026-05-10 05:30:52,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:30:52,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7503197af08e45fc7031 HTTP/1.1" 200 None 2026-05-10 05:30:52,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:30:52,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:30:52,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:30:52,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7503197af08e45fc7031 HTTP/1.1" 200 None 2026-05-10 05:30:52,104 - lava_callback - ERROR - Error processing callback for node 69fd7503197af08e45fc7031: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51438 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:32:22,787 - lava_callback - INFO - Received callback for node 69fd7555197af08e45fc7054 INFO: 172.20.0.1:54528 - "POST /node/69fd7555197af08e45fc7054 HTTP/1.0" 202 Accepted 2026-05-10 05:32:22,793 - lava_callback - INFO - Starting async job submit for node 69fd7555197af08e45fc7054 2026-05-10 05:32:22,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:32:22,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7555197af08e45fc7054 HTTP/1.1" 200 None 2026-05-10 05:32:22,808 - lava_callback - DEBUG - Processing node 69fd7555197af08e45fc7054: baseline-arm64-clabbe 2026-05-10 05:32:22,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7555197af08e45fc7054 2026-05-10 05:32:22,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:32:22,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7555197af08e45fc7054 HTTP/1.1" 200 None 2026-05-10 05:32:22,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:32:22,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:32:22,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:32:22,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7555197af08e45fc7054 HTTP/1.1" 200 None 2026-05-10 05:32:22,853 - lava_callback - ERROR - Error processing callback for node 69fd7555197af08e45fc7054: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47388 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:33:12,088 - lava_callback - INFO - Received callback for node 69fd758e197af08e45fc7079 INFO: 172.20.0.1:58322 - "POST /node/69fd758e197af08e45fc7079 HTTP/1.0" 202 Accepted 2026-05-10 05:33:12,093 - lava_callback - INFO - Starting async job submit for node 69fd758e197af08e45fc7079 2026-05-10 05:33:12,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:33:12,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd758e197af08e45fc7079 HTTP/1.1" 200 None 2026-05-10 05:33:12,107 - lava_callback - DEBUG - Processing node 69fd758e197af08e45fc7079: baseline-arm-baylibre 2026-05-10 05:33:12,107 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd758e197af08e45fc7079 2026-05-10 05:33:12,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:33:12,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd758e197af08e45fc7079 HTTP/1.1" 200 None 2026-05-10 05:33:12,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:33:12,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:33:12,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:33:12,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd758e197af08e45fc7079 HTTP/1.1" 200 None 2026-05-10 05:33:12,152 - lava_callback - ERROR - Error processing callback for node 69fd758e197af08e45fc7079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35514 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:34:02,791 - lava_callback - INFO - Received callback for node 69fd75c4197af08e45fc7089 INFO: 172.20.0.1:46342 - "POST /node/69fd75c4197af08e45fc7089 HTTP/1.0" 202 Accepted 2026-05-10 05:34:02,797 - lava_callback - INFO - Starting async job submit for node 69fd75c4197af08e45fc7089 2026-05-10 05:34:02,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:34:02,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd75c4197af08e45fc7089 HTTP/1.1" 200 None 2026-05-10 05:34:02,851 - lava_callback - DEBUG - Processing node 69fd75c4197af08e45fc7089: baseline-arm64-clabbe 2026-05-10 05:34:02,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd75c4197af08e45fc7089 2026-05-10 05:34:02,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:34:02,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd75c4197af08e45fc7089 HTTP/1.1" 200 None 2026-05-10 05:34:02,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:34:02,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:34:02,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:34:02,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd75c4197af08e45fc7089 HTTP/1.1" 200 None 2026-05-10 05:34:02,910 - lava_callback - ERROR - Error processing callback for node 69fd75c4197af08e45fc7089: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:35:12,335 - lava_callback - INFO - Received callback for node 69fd75fc197af08e45fc70ad INFO: 172.20.0.1:59980 - "POST /node/69fd75fc197af08e45fc70ad HTTP/1.0" 202 Accepted 2026-05-10 05:35:12,341 - lava_callback - INFO - Starting async job submit for node 69fd75fc197af08e45fc70ad 2026-05-10 05:35:12,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:12,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd75fc197af08e45fc70ad HTTP/1.1" 200 None 2026-05-10 05:35:12,357 - lava_callback - DEBUG - Processing node 69fd75fc197af08e45fc70ad: baseline-arm-baylibre 2026-05-10 05:35:12,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd75fc197af08e45fc70ad 2026-05-10 05:35:12,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:12,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd75fc197af08e45fc70ad HTTP/1.1" 200 None 2026-05-10 05:35:12,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:12,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:35:12,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:12,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd75fc197af08e45fc70ad HTTP/1.1" 200 None 2026-05-10 05:35:12,402 - lava_callback - ERROR - Error processing callback for node 69fd75fc197af08e45fc70ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60838 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:35:32,143 - lava_callback - INFO - Received callback for node 69fd7621197af08e45fc70bb INFO: 172.20.0.1:44232 - "POST /node/69fd7621197af08e45fc70bb HTTP/1.0" 202 Accepted 2026-05-10 05:35:32,149 - lava_callback - INFO - Starting async job submit for node 69fd7621197af08e45fc70bb 2026-05-10 05:35:32,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:32,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7621197af08e45fc70bb HTTP/1.1" 200 None 2026-05-10 05:35:32,166 - lava_callback - DEBUG - Processing node 69fd7621197af08e45fc70bb: baseline-arm-baylibre 2026-05-10 05:35:32,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7621197af08e45fc70bb 2026-05-10 05:35:32,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:32,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7621197af08e45fc70bb HTTP/1.1" 200 None 2026-05-10 05:35:32,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:32,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:35:32,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:35:32,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7621197af08e45fc70bb HTTP/1.1" 200 None 2026-05-10 05:35:32,217 - lava_callback - ERROR - Error processing callback for node 69fd7621197af08e45fc70bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54630 - "GET /node/67fcd10857bee17fc6342bb0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36520 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:36:42,868 - lava_callback - INFO - Received callback for node 69fd7657197af08e45fc70ca INFO: 172.20.0.1:59728 - "POST /node/69fd7657197af08e45fc70ca HTTP/1.0" 202 Accepted 2026-05-10 05:36:42,874 - lava_callback - INFO - Starting async job submit for node 69fd7657197af08e45fc70ca 2026-05-10 05:36:42,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:36:42,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7657197af08e45fc70ca HTTP/1.1" 200 None 2026-05-10 05:36:42,892 - lava_callback - DEBUG - Processing node 69fd7657197af08e45fc70ca: baseline-arm64-clabbe 2026-05-10 05:36:42,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7657197af08e45fc70ca 2026-05-10 05:36:42,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:36:42,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7657197af08e45fc70ca HTTP/1.1" 200 None 2026-05-10 05:36:42,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:36:42,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:36:42,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:36:42,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7657197af08e45fc70ca HTTP/1.1" 200 None 2026-05-10 05:36:42,937 - lava_callback - ERROR - Error processing callback for node 69fd7657197af08e45fc70ca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56654 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:37:32,301 - lava_callback - INFO - Received callback for node 69fd7692197af08e45fc70ed INFO: 172.20.0.1:57696 - "POST /node/69fd7692197af08e45fc70ed HTTP/1.0" 202 Accepted 2026-05-10 05:37:32,307 - lava_callback - INFO - Starting async job submit for node 69fd7692197af08e45fc70ed 2026-05-10 05:37:32,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:37:32,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7692197af08e45fc70ed HTTP/1.1" 200 None 2026-05-10 05:37:32,322 - lava_callback - DEBUG - Processing node 69fd7692197af08e45fc70ed: baseline-arm-baylibre 2026-05-10 05:37:32,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7692197af08e45fc70ed 2026-05-10 05:37:32,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:37:32,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7692197af08e45fc70ed HTTP/1.1" 200 None 2026-05-10 05:37:32,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:37:32,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:37:32,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:37:32,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7692197af08e45fc70ed HTTP/1.1" 200 None 2026-05-10 05:37:32,377 - lava_callback - ERROR - Error processing callback for node 69fd7692197af08e45fc70ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40866 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:38:22,927 - lava_callback - INFO - Received callback for node 69fd76c6197af08e45fc7108 INFO: 172.20.0.1:47324 - "POST /node/69fd76c6197af08e45fc7108 HTTP/1.0" 202 Accepted 2026-05-10 05:38:22,933 - lava_callback - INFO - Starting async job submit for node 69fd76c6197af08e45fc7108 2026-05-10 05:38:22,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:38:22,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd76c6197af08e45fc7108 HTTP/1.1" 200 None 2026-05-10 05:38:22,947 - lava_callback - DEBUG - Processing node 69fd76c6197af08e45fc7108: baseline-arm64-clabbe 2026-05-10 05:38:22,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd76c6197af08e45fc7108 2026-05-10 05:38:22,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:38:22,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd76c6197af08e45fc7108 HTTP/1.1" 200 None 2026-05-10 05:38:22,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:38:22,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:38:22,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:38:23,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd76c6197af08e45fc7108 HTTP/1.1" 200 None 2026-05-10 05:38:23,004 - lava_callback - ERROR - Error processing callback for node 69fd76c6197af08e45fc7108: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51718 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:39:32,386 - lava_callback - INFO - Received callback for node 69fd7701197af08e45fc7127 INFO: 172.20.0.1:45646 - "POST /node/69fd7701197af08e45fc7127 HTTP/1.0" 202 Accepted 2026-05-10 05:39:32,392 - lava_callback - INFO - Starting async job submit for node 69fd7701197af08e45fc7127 2026-05-10 05:39:32,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:39:32,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7701197af08e45fc7127 HTTP/1.1" 200 None 2026-05-10 05:39:32,422 - lava_callback - DEBUG - Processing node 69fd7701197af08e45fc7127: baseline-arm-baylibre 2026-05-10 05:39:32,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7701197af08e45fc7127 2026-05-10 05:39:32,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:39:32,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7701197af08e45fc7127 HTTP/1.1" 200 None 2026-05-10 05:39:32,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:39:32,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:39:32,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:39:32,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7701197af08e45fc7127 HTTP/1.1" 200 None 2026-05-10 05:39:32,469 - lava_callback - ERROR - Error processing callback for node 69fd7701197af08e45fc7127: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46748 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:40:23,121 - lava_callback - INFO - Received callback for node 69fd7734197af08e45fc7132 INFO: 172.20.0.1:42328 - "POST /node/69fd7734197af08e45fc7132 HTTP/1.0" 202 Accepted 2026-05-10 05:40:23,126 - lava_callback - INFO - Starting async job submit for node 69fd7734197af08e45fc7132 2026-05-10 05:40:23,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:40:23,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7734197af08e45fc7132 HTTP/1.1" 200 None 2026-05-10 05:40:23,141 - lava_callback - DEBUG - Processing node 69fd7734197af08e45fc7132: baseline-arm64-clabbe 2026-05-10 05:40:23,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7734197af08e45fc7132 2026-05-10 05:40:23,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:40:23,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7734197af08e45fc7132 HTTP/1.1" 200 None 2026-05-10 05:40:23,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:40:23,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:40:23,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:40:23,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7734197af08e45fc7132 HTTP/1.1" 200 None 2026-05-10 05:40:23,194 - lava_callback - ERROR - Error processing callback for node 69fd7734197af08e45fc7132: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39008 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:41:23,120 - lava_callback - INFO - Received callback for node 69fd7774197af08e45fc7154 INFO: 172.20.0.1:51916 - "POST /node/69fd7774197af08e45fc7154 HTTP/1.0" 202 Accepted 2026-05-10 05:41:23,126 - lava_callback - INFO - Starting async job submit for node 69fd7774197af08e45fc7154 2026-05-10 05:41:23,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:41:23,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7774197af08e45fc7154 HTTP/1.1" 200 None 2026-05-10 05:41:23,141 - lava_callback - DEBUG - Processing node 69fd7774197af08e45fc7154: baseline-arm-clabbe 2026-05-10 05:41:23,141 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7774197af08e45fc7154 2026-05-10 05:41:23,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:41:23,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7774197af08e45fc7154 HTTP/1.1" 200 None 2026-05-10 05:41:23,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:41:23,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:41:23,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:41:23,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7774197af08e45fc7154 HTTP/1.1" 200 None 2026-05-10 05:41:23,190 - lava_callback - ERROR - Error processing callback for node 69fd7774197af08e45fc7154: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49122 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:42:03,106 - lava_callback - INFO - Received callback for node 69fd7798197af08e45fc7164 INFO: 172.20.0.1:36266 - "POST /node/69fd7798197af08e45fc7164 HTTP/1.0" 202 Accepted 2026-05-10 05:42:03,112 - lava_callback - INFO - Starting async job submit for node 69fd7798197af08e45fc7164 2026-05-10 05:42:03,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:03,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7798197af08e45fc7164 HTTP/1.1" 200 None 2026-05-10 05:42:03,128 - lava_callback - DEBUG - Processing node 69fd7798197af08e45fc7164: baseline-arm-clabbe 2026-05-10 05:42:03,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7798197af08e45fc7164 2026-05-10 05:42:03,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:03,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7798197af08e45fc7164 HTTP/1.1" 200 None 2026-05-10 05:42:03,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:03,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:42:03,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:03,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7798197af08e45fc7164 HTTP/1.1" 200 None 2026-05-10 05:42:03,175 - lava_callback - ERROR - Error processing callback for node 69fd7798197af08e45fc7164: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49162 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:42:43,170 - lava_callback - INFO - Received callback for node 69fd77cb197af08e45fc7173 INFO: 172.20.0.1:57872 - "POST /node/69fd77cb197af08e45fc7173 HTTP/1.0" 202 Accepted 2026-05-10 05:42:43,176 - lava_callback - INFO - Starting async job submit for node 69fd77cb197af08e45fc7173 2026-05-10 05:42:43,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:43,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd77cb197af08e45fc7173 HTTP/1.1" 200 None 2026-05-10 05:42:43,206 - lava_callback - DEBUG - Processing node 69fd77cb197af08e45fc7173: baseline-arm64-clabbe 2026-05-10 05:42:43,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd77cb197af08e45fc7173 2026-05-10 05:42:43,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:43,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd77cb197af08e45fc7173 HTTP/1.1" 200 None 2026-05-10 05:42:43,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:43,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:42:43,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:42:43,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd77cb197af08e45fc7173 HTTP/1.1" 200 None 2026-05-10 05:42:43,257 - lava_callback - ERROR - Error processing callback for node 69fd77cb197af08e45fc7173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57892 - "GET /node/6940c81a460bc8e26511184f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41438 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:43:43,190 - lava_callback - INFO - Received callback for node 69fd7808197af08e45fc7194 INFO: 172.20.0.1:43592 - "POST /node/69fd7808197af08e45fc7194 HTTP/1.0" 202 Accepted 2026-05-10 05:43:43,196 - lava_callback - INFO - Starting async job submit for node 69fd7808197af08e45fc7194 2026-05-10 05:43:43,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:43:43,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7808197af08e45fc7194 HTTP/1.1" 200 None 2026-05-10 05:43:43,211 - lava_callback - DEBUG - Processing node 69fd7808197af08e45fc7194: baseline-arm-clabbe 2026-05-10 05:43:43,211 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7808197af08e45fc7194 2026-05-10 05:43:43,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:43:43,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7808197af08e45fc7194 HTTP/1.1" 200 None 2026-05-10 05:43:43,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:43:43,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:43:43,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:43:43,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7808197af08e45fc7194 HTTP/1.1" 200 None 2026-05-10 05:43:43,262 - lava_callback - ERROR - Error processing callback for node 69fd7808197af08e45fc7194: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59532 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:44:43,267 - lava_callback - INFO - Received callback for node 69fd783b197af08e45fc71a3 INFO: 172.20.0.1:40748 - "POST /node/69fd783b197af08e45fc71a3 HTTP/1.0" 202 Accepted 2026-05-10 05:44:43,272 - lava_callback - INFO - Starting async job submit for node 69fd783b197af08e45fc71a3 2026-05-10 05:44:43,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:44:43,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd783b197af08e45fc71a3 HTTP/1.1" 200 None 2026-05-10 05:44:43,288 - lava_callback - DEBUG - Processing node 69fd783b197af08e45fc71a3: baseline-arm64-clabbe 2026-05-10 05:44:43,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd783b197af08e45fc71a3 2026-05-10 05:44:43,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:44:43,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd783b197af08e45fc71a3 HTTP/1.1" 200 None 2026-05-10 05:44:43,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:44:43,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:44:43,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:44:43,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd783b197af08e45fc71a3 HTTP/1.1" 200 None 2026-05-10 05:44:43,342 - lava_callback - ERROR - Error processing callback for node 69fd783b197af08e45fc71a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53032 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:45:43,341 - lava_callback - INFO - Received callback for node 69fd7879197af08e45fc71c7 INFO: 172.20.0.1:52680 - "POST /node/69fd7879197af08e45fc71c7 HTTP/1.0" 202 Accepted 2026-05-10 05:45:43,346 - lava_callback - INFO - Starting async job submit for node 69fd7879197af08e45fc71c7 2026-05-10 05:45:43,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:45:43,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7879197af08e45fc71c7 HTTP/1.1" 200 None 2026-05-10 05:45:43,361 - lava_callback - DEBUG - Processing node 69fd7879197af08e45fc71c7: baseline-arm-clabbe 2026-05-10 05:45:43,362 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7879197af08e45fc71c7 2026-05-10 05:45:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:45:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7879197af08e45fc71c7 HTTP/1.1" 200 None 2026-05-10 05:45:43,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:45:43,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:45:43,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:45:43,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7879197af08e45fc71c7 HTTP/1.1" 200 None 2026-05-10 05:45:43,407 - lava_callback - ERROR - Error processing callback for node 69fd7879197af08e45fc71c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59660 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:46:23,290 - lava_callback - INFO - Received callback for node 69fd789e197af08e45fc71d9 INFO: 172.20.0.1:35994 - "POST /node/69fd789e197af08e45fc71d9 HTTP/1.0" 202 Accepted 2026-05-10 05:46:23,296 - lava_callback - INFO - Starting async job submit for node 69fd789e197af08e45fc71d9 2026-05-10 05:46:23,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:46:23,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd789e197af08e45fc71d9 HTTP/1.1" 200 None 2026-05-10 05:46:23,313 - lava_callback - DEBUG - Processing node 69fd789e197af08e45fc71d9: baseline-arm-clabbe 2026-05-10 05:46:23,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd789e197af08e45fc71d9 2026-05-10 05:46:23,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:46:23,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd789e197af08e45fc71d9 HTTP/1.1" 200 None 2026-05-10 05:46:23,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:46:23,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:46:23,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:46:23,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd789e197af08e45fc71d9 HTTP/1.1" 200 None 2026-05-10 05:46:23,358 - lava_callback - ERROR - Error processing callback for node 69fd789e197af08e45fc71d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56976 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:47:03,429 - lava_callback - INFO - Received callback for node 69fd78c3197af08e45fc71e7 INFO: 172.20.0.1:39558 - "POST /node/69fd78c3197af08e45fc71e7 HTTP/1.0" 202 Accepted 2026-05-10 05:47:03,434 - lava_callback - INFO - Starting async job submit for node 69fd78c3197af08e45fc71e7 2026-05-10 05:47:03,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:03,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd78c3197af08e45fc71e7 HTTP/1.1" 200 None 2026-05-10 05:47:03,449 - lava_callback - DEBUG - Processing node 69fd78c3197af08e45fc71e7: baseline-arm-clabbe 2026-05-10 05:47:03,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd78c3197af08e45fc71e7 2026-05-10 05:47:03,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:03,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd78c3197af08e45fc71e7 HTTP/1.1" 200 None 2026-05-10 05:47:03,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:03,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:47:03,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:03,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd78c3197af08e45fc71e7 HTTP/1.1" 200 None 2026-05-10 05:47:03,494 - lava_callback - ERROR - Error processing callback for node 69fd78c3197af08e45fc71e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48066 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:47:43,327 - lava_callback - INFO - Received callback for node 69fd78f5197af08e45fc71f4 INFO: 172.20.0.1:53564 - "POST /node/69fd78f5197af08e45fc71f4 HTTP/1.0" 202 Accepted 2026-05-10 05:47:43,333 - lava_callback - INFO - Starting async job submit for node 69fd78f5197af08e45fc71f4 2026-05-10 05:47:43,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:43,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd78f5197af08e45fc71f4 HTTP/1.1" 200 None 2026-05-10 05:47:43,347 - lava_callback - DEBUG - Processing node 69fd78f5197af08e45fc71f4: baseline-arm64-clabbe 2026-05-10 05:47:43,348 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd78f5197af08e45fc71f4 2026-05-10 05:47:43,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:43,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd78f5197af08e45fc71f4 HTTP/1.1" 200 None 2026-05-10 05:47:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:43,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:47:43,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:47:43,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd78f5197af08e45fc71f4 HTTP/1.1" 200 None 2026-05-10 05:47:43,410 - lava_callback - ERROR - Error processing callback for node 69fd78f5197af08e45fc71f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34440 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:49:03,532 - lava_callback - INFO - Received callback for node 69fd7941197af08e45fc7228 INFO: 172.20.0.1:36940 - "POST /node/69fd7941197af08e45fc7228 HTTP/1.0" 202 Accepted 2026-05-10 05:49:03,538 - lava_callback - INFO - Starting async job submit for node 69fd7941197af08e45fc7228 2026-05-10 05:49:03,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:49:03,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7941197af08e45fc7228 HTTP/1.1" 200 None 2026-05-10 05:49:03,552 - lava_callback - DEBUG - Processing node 69fd7941197af08e45fc7228: baseline-arm64-clabbe 2026-05-10 05:49:03,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7941197af08e45fc7228 2026-05-10 05:49:03,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:49:03,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7941197af08e45fc7228 HTTP/1.1" 200 None 2026-05-10 05:49:03,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:49:03,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:49:03,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:49:03,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7941197af08e45fc7228 HTTP/1.1" 200 None 2026-05-10 05:49:03,604 - lava_callback - ERROR - Error processing callback for node 69fd7941197af08e45fc7228: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49880 - "GET /node/68f5f8b8b416eab2dc8d972f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52130 - "GET /node/69f236bef5ce4820821efaa3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41874 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:50:23,520 - lava_callback - INFO - Received callback for node 69fd798a197af08e45fc7248 INFO: 172.20.0.1:51796 - "POST /node/69fd798a197af08e45fc7248 HTTP/1.0" 202 Accepted 2026-05-10 05:50:23,526 - lava_callback - INFO - Starting async job submit for node 69fd798a197af08e45fc7248 2026-05-10 05:50:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:50:23,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd798a197af08e45fc7248 HTTP/1.1" 200 None 2026-05-10 05:50:23,543 - lava_callback - DEBUG - Processing node 69fd798a197af08e45fc7248: baseline-arm64-clabbe 2026-05-10 05:50:23,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd798a197af08e45fc7248 2026-05-10 05:50:23,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:50:23,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd798a197af08e45fc7248 HTTP/1.1" 200 None 2026-05-10 05:50:23,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:50:23,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:50:23,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:50:23,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd798a197af08e45fc7248 HTTP/1.1" 200 None 2026-05-10 05:50:23,588 - lava_callback - ERROR - Error processing callback for node 69fd798a197af08e45fc7248: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54624 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:51:23,525 - lava_callback - INFO - Received callback for node 69fd79d5197af08e45fc727d INFO: 172.20.0.1:49160 - "POST /node/69fd79d5197af08e45fc727d HTTP/1.0" 202 Accepted 2026-05-10 05:51:23,530 - lava_callback - INFO - Starting async job submit for node 69fd79d5197af08e45fc727d 2026-05-10 05:51:23,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:51:23,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd79d5197af08e45fc727d HTTP/1.1" 200 None 2026-05-10 05:51:23,546 - lava_callback - DEBUG - Processing node 69fd79d5197af08e45fc727d: baseline-arm64-clabbe 2026-05-10 05:51:23,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd79d5197af08e45fc727d 2026-05-10 05:51:23,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:51:23,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd79d5197af08e45fc727d HTTP/1.1" 200 None 2026-05-10 05:51:23,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:51:23,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:51:23,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:51:23,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd79d5197af08e45fc727d HTTP/1.1" 200 None 2026-05-10 05:51:23,592 - lava_callback - ERROR - Error processing callback for node 69fd79d5197af08e45fc727d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37856 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:52:43,541 - lava_callback - INFO - Received callback for node 69fd7a20197af08e45fc729d INFO: 172.20.0.1:58300 - "POST /node/69fd7a20197af08e45fc729d HTTP/1.0" 202 Accepted 2026-05-10 05:52:43,547 - lava_callback - INFO - Starting async job submit for node 69fd7a20197af08e45fc729d 2026-05-10 05:52:43,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:52:43,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7a20197af08e45fc729d HTTP/1.1" 200 None 2026-05-10 05:52:43,569 - lava_callback - DEBUG - Processing node 69fd7a20197af08e45fc729d: baseline-arm64-clabbe 2026-05-10 05:52:43,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7a20197af08e45fc729d 2026-05-10 05:52:43,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:52:43,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7a20197af08e45fc729d HTTP/1.1" 200 None 2026-05-10 05:52:43,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:52:43,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1875a9d11f026cebb527 HTTP/1.1" 200 None 2026-05-10 05:52:43,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:52:43,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7a20197af08e45fc729d HTTP/1.1" 200 None 2026-05-10 05:52:43,623 - lava_callback - ERROR - Error processing callback for node 69fd7a20197af08e45fc729d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57740 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:53:33,270 - lava_callback - INFO - Received callback for node 69fd7a59197af08e45fc72c0 INFO: 172.20.0.1:57604 - "POST /node/69fd7a59197af08e45fc72c0 HTTP/1.0" 202 Accepted 2026-05-10 05:53:33,276 - lava_callback - INFO - Starting async job submit for node 69fd7a59197af08e45fc72c0 2026-05-10 05:53:33,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:53:33,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7a59197af08e45fc72c0 HTTP/1.1" 200 None 2026-05-10 05:53:33,291 - lava_callback - DEBUG - Processing node 69fd7a59197af08e45fc72c0: baseline-arm-baylibre 2026-05-10 05:53:33,292 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7a59197af08e45fc72c0 2026-05-10 05:53:33,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:53:33,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7a59197af08e45fc72c0 HTTP/1.1" 200 None 2026-05-10 05:53:33,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:53:33,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:53:33,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:53:33,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7a59197af08e45fc72c0 HTTP/1.1" 200 None 2026-05-10 05:53:33,340 - lava_callback - ERROR - Error processing callback for node 69fd7a59197af08e45fc72c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET /node/69867c86177ca0f097bd513f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59552 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:54:53,407 - lava_callback - INFO - Received callback for node 69fd7aa3197af08e45fc72d7 INFO: 172.20.0.1:58976 - "POST /node/69fd7aa3197af08e45fc72d7 HTTP/1.0" 202 Accepted 2026-05-10 05:54:53,412 - lava_callback - INFO - Starting async job submit for node 69fd7aa3197af08e45fc72d7 2026-05-10 05:54:53,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:54:53,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7aa3197af08e45fc72d7 HTTP/1.1" 200 None 2026-05-10 05:54:53,435 - lava_callback - DEBUG - Processing node 69fd7aa3197af08e45fc72d7: baseline-arm-baylibre 2026-05-10 05:54:53,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7aa3197af08e45fc72d7 2026-05-10 05:54:53,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:54:53,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7aa3197af08e45fc72d7 HTTP/1.1" 200 None 2026-05-10 05:54:53,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:54:53,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:54:53,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:54:53,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7aa3197af08e45fc72d7 HTTP/1.1" 200 None 2026-05-10 05:54:53,485 - lava_callback - ERROR - Error processing callback for node 69fd7aa3197af08e45fc72d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35910 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:55:33,252 - lava_callback - INFO - Received callback for node 69fd7ac8197af08e45fc72e7 INFO: 172.20.0.1:46692 - "POST /node/69fd7ac8197af08e45fc72e7 HTTP/1.0" 202 Accepted 2026-05-10 05:55:33,258 - lava_callback - INFO - Starting async job submit for node 69fd7ac8197af08e45fc72e7 2026-05-10 05:55:33,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:55:33,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7ac8197af08e45fc72e7 HTTP/1.1" 200 None 2026-05-10 05:55:33,272 - lava_callback - DEBUG - Processing node 69fd7ac8197af08e45fc72e7: baseline-arm-baylibre 2026-05-10 05:55:33,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7ac8197af08e45fc72e7 2026-05-10 05:55:33,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:55:33,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7ac8197af08e45fc72e7 HTTP/1.1" 200 None 2026-05-10 05:55:33,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:55:33,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:55:33,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:55:33,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7ac8197af08e45fc72e7 HTTP/1.1" 200 None 2026-05-10 05:55:33,316 - lava_callback - ERROR - Error processing callback for node 69fd7ac8197af08e45fc72e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35740 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:56:13,306 - lava_callback - INFO - Received callback for node 69fd7aef197af08e45fc72f5 INFO: 172.20.0.1:43494 - "POST /node/69fd7aef197af08e45fc72f5 HTTP/1.0" 202 Accepted 2026-05-10 05:56:13,312 - lava_callback - INFO - Starting async job submit for node 69fd7aef197af08e45fc72f5 2026-05-10 05:56:13,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:13,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7aef197af08e45fc72f5 HTTP/1.1" 200 None 2026-05-10 05:56:13,327 - lava_callback - DEBUG - Processing node 69fd7aef197af08e45fc72f5: baseline-arm-baylibre 2026-05-10 05:56:13,327 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7aef197af08e45fc72f5 2026-05-10 05:56:13,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:13,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7aef197af08e45fc72f5 HTTP/1.1" 200 None 2026-05-10 05:56:13,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:13,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:56:13,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:13,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7aef197af08e45fc72f5 HTTP/1.1" 200 None 2026-05-10 05:56:13,378 - lava_callback - ERROR - Error processing callback for node 69fd7aef197af08e45fc72f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60026 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:56:53,319 - lava_callback - INFO - Received callback for node 69fd7b13197af08e45fc7306 INFO: 172.20.0.1:57848 - "POST /node/69fd7b13197af08e45fc7306 HTTP/1.0" 202 Accepted 2026-05-10 05:56:53,325 - lava_callback - INFO - Starting async job submit for node 69fd7b13197af08e45fc7306 2026-05-10 05:56:53,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:53,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b13197af08e45fc7306 HTTP/1.1" 200 None 2026-05-10 05:56:53,341 - lava_callback - DEBUG - Processing node 69fd7b13197af08e45fc7306: baseline-arm-baylibre 2026-05-10 05:56:53,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7b13197af08e45fc7306 2026-05-10 05:56:53,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:53,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b13197af08e45fc7306 HTTP/1.1" 200 None 2026-05-10 05:56:53,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:53,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:56:53,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:56:53,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7b13197af08e45fc7306 HTTP/1.1" 200 None 2026-05-10 05:56:53,393 - lava_callback - ERROR - Error processing callback for node 69fd7b13197af08e45fc7306: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35860 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:57:23,780 - lava_callback - INFO - Received callback for node 69fd7b39197af08e45fc7316 INFO: 172.20.0.1:55942 - "POST /node/69fd7b39197af08e45fc7316 HTTP/1.0" 202 Accepted 2026-05-10 05:57:23,785 - lava_callback - INFO - Starting async job submit for node 69fd7b39197af08e45fc7316 2026-05-10 05:57:23,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:57:23,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b39197af08e45fc7316 HTTP/1.1" 200 None 2026-05-10 05:57:23,802 - lava_callback - DEBUG - Processing node 69fd7b39197af08e45fc7316: baseline-arm-clabbe 2026-05-10 05:57:23,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7b39197af08e45fc7316 2026-05-10 05:57:23,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:57:23,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b39197af08e45fc7316 HTTP/1.1" 200 None 2026-05-10 05:57:23,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:57:23,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:57:23,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:57:23,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7b39197af08e45fc7316 HTTP/1.1" 200 None 2026-05-10 05:57:23,858 - lava_callback - ERROR - Error processing callback for node 69fd7b39197af08e45fc7316: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36070 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:58:03,787 - lava_callback - INFO - Received callback for node 69fd7b5e197af08e45fc7329 INFO: 172.20.0.1:50616 - "POST /node/69fd7b5e197af08e45fc7329 HTTP/1.0" 202 Accepted 2026-05-10 05:58:03,792 - lava_callback - INFO - Starting async job submit for node 69fd7b5e197af08e45fc7329 2026-05-10 05:58:03,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:03,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b5e197af08e45fc7329 HTTP/1.1" 200 None 2026-05-10 05:58:03,812 - lava_callback - DEBUG - Processing node 69fd7b5e197af08e45fc7329: baseline-arm-clabbe 2026-05-10 05:58:03,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7b5e197af08e45fc7329 2026-05-10 05:58:03,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:03,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b5e197af08e45fc7329 HTTP/1.1" 200 None 2026-05-10 05:58:03,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:03,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:58:03,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:03,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7b5e197af08e45fc7329 HTTP/1.1" 200 None 2026-05-10 05:58:03,865 - lava_callback - ERROR - Error processing callback for node 69fd7b5e197af08e45fc7329: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58296 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:58:43,838 - lava_callback - INFO - Received callback for node 69fd7b83197af08e45fc7339 INFO: 172.20.0.1:43586 - "POST /node/69fd7b83197af08e45fc7339 HTTP/1.0" 202 Accepted 2026-05-10 05:58:43,844 - lava_callback - INFO - Starting async job submit for node 69fd7b83197af08e45fc7339 2026-05-10 05:58:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:43,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b83197af08e45fc7339 HTTP/1.1" 200 None 2026-05-10 05:58:43,859 - lava_callback - DEBUG - Processing node 69fd7b83197af08e45fc7339: baseline-arm-clabbe 2026-05-10 05:58:43,859 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7b83197af08e45fc7339 2026-05-10 05:58:43,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:43,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7b83197af08e45fc7339 HTTP/1.1" 200 None 2026-05-10 05:58:43,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:43,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:58:43,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:58:43,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7b83197af08e45fc7339 HTTP/1.1" 200 None 2026-05-10 05:58:43,906 - lava_callback - ERROR - Error processing callback for node 69fd7b83197af08e45fc7339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58096 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:59:23,818 - lava_callback - INFO - Received callback for node 69fd7ba7197af08e45fc734a INFO: 172.20.0.1:43124 - "POST /node/69fd7ba7197af08e45fc734a HTTP/1.0" 202 Accepted 2026-05-10 05:59:23,826 - lava_callback - INFO - Starting async job submit for node 69fd7ba7197af08e45fc734a 2026-05-10 05:59:23,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:23,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7ba7197af08e45fc734a HTTP/1.1" 200 None 2026-05-10 05:59:23,847 - lava_callback - DEBUG - Processing node 69fd7ba7197af08e45fc734a: baseline-arm-clabbe 2026-05-10 05:59:23,847 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7ba7197af08e45fc734a 2026-05-10 05:59:23,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:23,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7ba7197af08e45fc734a HTTP/1.1" 200 None 2026-05-10 05:59:23,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:23,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:59:23,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:23,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7ba7197af08e45fc734a HTTP/1.1" 200 None 2026-05-10 05:59:23,904 - lava_callback - ERROR - Error processing callback for node 69fd7ba7197af08e45fc734a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44350 - "GET / HTTP/1.0" 200 OK 2026-05-10 05:59:43,849 - lava_callback - INFO - Received callback for node 69fd7bcd197af08e45fc735b INFO: 172.20.0.1:46590 - "POST /node/69fd7bcd197af08e45fc735b HTTP/1.0" 202 Accepted 2026-05-10 05:59:43,854 - lava_callback - INFO - Starting async job submit for node 69fd7bcd197af08e45fc735b 2026-05-10 05:59:43,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:43,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7bcd197af08e45fc735b HTTP/1.1" 200 None 2026-05-10 05:59:43,869 - lava_callback - DEBUG - Processing node 69fd7bcd197af08e45fc735b: baseline-arm-clabbe 2026-05-10 05:59:43,870 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7bcd197af08e45fc735b 2026-05-10 05:59:43,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:43,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7bcd197af08e45fc735b HTTP/1.1" 200 None 2026-05-10 05:59:43,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:43,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 05:59:43,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 05:59:43,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7bcd197af08e45fc735b HTTP/1.1" 200 None 2026-05-10 05:59:43,915 - lava_callback - ERROR - Error processing callback for node 69fd7bcd197af08e45fc735b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54844 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:00:23,851 - lava_callback - INFO - Received callback for node 69fd7bf4197af08e45fc736f INFO: 172.20.0.1:54500 - "POST /node/69fd7bf4197af08e45fc736f HTTP/1.0" 202 Accepted 2026-05-10 06:00:23,857 - lava_callback - INFO - Starting async job submit for node 69fd7bf4197af08e45fc736f 2026-05-10 06:00:23,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:00:23,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7bf4197af08e45fc736f HTTP/1.1" 200 None 2026-05-10 06:00:23,886 - lava_callback - DEBUG - Processing node 69fd7bf4197af08e45fc736f: baseline-arm-clabbe 2026-05-10 06:00:23,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7bf4197af08e45fc736f 2026-05-10 06:00:23,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:00:23,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7bf4197af08e45fc736f HTTP/1.1" 200 None 2026-05-10 06:00:23,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:00:23,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 06:00:23,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:00:23,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7bf4197af08e45fc736f HTTP/1.1" 200 None 2026-05-10 06:00:23,938 - lava_callback - ERROR - Error processing callback for node 69fd7bf4197af08e45fc736f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46330 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:01:03,908 - lava_callback - INFO - Received callback for node 69fd7c1b197af08e45fc737d INFO: 172.20.0.1:36066 - "POST /node/69fd7c1b197af08e45fc737d HTTP/1.0" 202 Accepted 2026-05-10 06:01:03,914 - lava_callback - INFO - Starting async job submit for node 69fd7c1b197af08e45fc737d 2026-05-10 06:01:03,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:03,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c1b197af08e45fc737d HTTP/1.1" 200 None 2026-05-10 06:01:03,932 - lava_callback - DEBUG - Processing node 69fd7c1b197af08e45fc737d: baseline-arm-clabbe 2026-05-10 06:01:03,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7c1b197af08e45fc737d 2026-05-10 06:01:03,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:03,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c1b197af08e45fc737d HTTP/1.1" 200 None 2026-05-10 06:01:03,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:03,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 06:01:03,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:03,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7c1b197af08e45fc737d HTTP/1.1" 200 None 2026-05-10 06:01:03,976 - lava_callback - ERROR - Error processing callback for node 69fd7c1b197af08e45fc737d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44036 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:01:43,884 - lava_callback - INFO - Received callback for node 69fd7c43197af08e45fc738f INFO: 172.20.0.1:49798 - "POST /node/69fd7c43197af08e45fc738f HTTP/1.0" 202 Accepted 2026-05-10 06:01:43,889 - lava_callback - INFO - Starting async job submit for node 69fd7c43197af08e45fc738f 2026-05-10 06:01:43,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:43,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c43197af08e45fc738f HTTP/1.1" 200 None 2026-05-10 06:01:43,904 - lava_callback - DEBUG - Processing node 69fd7c43197af08e45fc738f: baseline-arm-clabbe 2026-05-10 06:01:43,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7c43197af08e45fc738f 2026-05-10 06:01:43,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:43,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c43197af08e45fc738f HTTP/1.1" 200 None 2026-05-10 06:01:43,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:43,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 06:01:43,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:01:43,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7c43197af08e45fc738f HTTP/1.1" 200 None 2026-05-10 06:01:43,963 - lava_callback - ERROR - Error processing callback for node 69fd7c43197af08e45fc738f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35566 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:02:23,976 - lava_callback - INFO - Received callback for node 69fd7c6b197af08e45fc73a2 INFO: 172.20.0.1:57922 - "POST /node/69fd7c6b197af08e45fc73a2 HTTP/1.0" 202 Accepted 2026-05-10 06:02:23,982 - lava_callback - INFO - Starting async job submit for node 69fd7c6b197af08e45fc73a2 2026-05-10 06:02:23,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:02:23,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c6b197af08e45fc73a2 HTTP/1.1" 200 None 2026-05-10 06:02:23,998 - lava_callback - DEBUG - Processing node 69fd7c6b197af08e45fc73a2: baseline-arm-clabbe 2026-05-10 06:02:23,999 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7c6b197af08e45fc73a2 2026-05-10 06:02:23,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:02:24,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c6b197af08e45fc73a2 HTTP/1.1" 200 None 2026-05-10 06:02:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:02:24,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 06:02:24,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:02:24,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7c6b197af08e45fc73a2 HTTP/1.1" 200 None 2026-05-10 06:02:24,052 - lava_callback - ERROR - Error processing callback for node 69fd7c6b197af08e45fc73a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42814 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:03:03,991 - lava_callback - INFO - Received callback for node 69fd7c92197af08e45fc73af INFO: 172.20.0.1:39180 - "POST /node/69fd7c92197af08e45fc73af HTTP/1.0" 202 Accepted 2026-05-10 06:03:03,998 - lava_callback - INFO - Starting async job submit for node 69fd7c92197af08e45fc73af 2026-05-10 06:03:03,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:04,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c92197af08e45fc73af HTTP/1.1" 200 None 2026-05-10 06:03:04,014 - lava_callback - DEBUG - Processing node 69fd7c92197af08e45fc73af: baseline-arm-clabbe 2026-05-10 06:03:04,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7c92197af08e45fc73af 2026-05-10 06:03:04,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:04,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7c92197af08e45fc73af HTTP/1.1" 200 None 2026-05-10 06:03:04,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:04,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 06:03:04,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:04,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7c92197af08e45fc73af HTTP/1.1" 200 None 2026-05-10 06:03:04,058 - lava_callback - ERROR - Error processing callback for node 69fd7c92197af08e45fc73af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52476 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:03:44,045 - lava_callback - INFO - Received callback for node 69fd7cb9197af08e45fc73bf INFO: 172.20.0.1:39540 - "POST /node/69fd7cb9197af08e45fc73bf HTTP/1.0" 202 Accepted 2026-05-10 06:03:44,051 - lava_callback - INFO - Starting async job submit for node 69fd7cb9197af08e45fc73bf 2026-05-10 06:03:44,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:44,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7cb9197af08e45fc73bf HTTP/1.1" 200 None 2026-05-10 06:03:44,070 - lava_callback - DEBUG - Processing node 69fd7cb9197af08e45fc73bf: baseline-arm-clabbe 2026-05-10 06:03:44,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7cb9197af08e45fc73bf 2026-05-10 06:03:44,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:44,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7cb9197af08e45fc73bf HTTP/1.1" 200 None 2026-05-10 06:03:44,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:44,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 06:03:44,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:03:44,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7cb9197af08e45fc73bf HTTP/1.1" 200 None 2026-05-10 06:03:44,115 - lava_callback - ERROR - Error processing callback for node 69fd7cb9197af08e45fc73bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49186 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:04:24,041 - lava_callback - INFO - Received callback for node 69fd7ce1197af08e45fc73d7 INFO: 172.20.0.1:33602 - "POST /node/69fd7ce1197af08e45fc73d7 HTTP/1.0" 202 Accepted 2026-05-10 06:04:24,047 - lava_callback - INFO - Starting async job submit for node 69fd7ce1197af08e45fc73d7 2026-05-10 06:04:24,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:04:24,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7ce1197af08e45fc73d7 HTTP/1.1" 200 None 2026-05-10 06:04:24,066 - lava_callback - DEBUG - Processing node 69fd7ce1197af08e45fc73d7: baseline-arm-clabbe 2026-05-10 06:04:24,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd7ce1197af08e45fc73d7 2026-05-10 06:04:24,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:04:24,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd7ce1197af08e45fc73d7 HTTP/1.1" 200 None 2026-05-10 06:04:24,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:04:24,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa1865a9d11f026cebb518 HTTP/1.1" 200 None 2026-05-10 06:04:24,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:04:24,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd7ce1197af08e45fc73d7 HTTP/1.1" 200 None 2026-05-10 06:04:24,129 - lava_callback - ERROR - Error processing callback for node 69fd7ce1197af08e45fc73d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46548 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 06:45:16,082 - lava_callback - INFO - Received callback for node 69fd8669197af08e45fc7472 INFO: 172.20.0.1:46562 - "POST /node/69fd8669197af08e45fc7472 HTTP/1.0" 202 Accepted 2026-05-10 06:45:16,089 - lava_callback - INFO - Starting async job submit for node 69fd8669197af08e45fc7472 2026-05-10 06:45:16,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:16,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8669197af08e45fc7472 HTTP/1.1" 200 None 2026-05-10 06:45:16,116 - lava_callback - DEBUG - Processing node 69fd8669197af08e45fc7472: baseline-arm-baylibre 2026-05-10 06:45:16,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8669197af08e45fc7472 2026-05-10 06:45:16,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:16,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8669197af08e45fc7472 HTTP/1.1" 200 None 2026-05-10 06:45:16,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:16,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:45:16,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:16,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8669197af08e45fc7472 HTTP/1.1" 200 None 2026-05-10 06:45:16,179 - lava_callback - ERROR - Error processing callback for node 69fd8669197af08e45fc7472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59944 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:45:36,049 - lava_callback - INFO - Received callback for node 69fd868c197af08e45fc7483 INFO: 172.20.0.1:39690 - "POST /node/69fd868c197af08e45fc7483 HTTP/1.0" 202 Accepted 2026-05-10 06:45:36,055 - lava_callback - INFO - Starting async job submit for node 69fd868c197af08e45fc7483 2026-05-10 06:45:36,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:36,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd868c197af08e45fc7483 HTTP/1.1" 200 None 2026-05-10 06:45:36,070 - lava_callback - DEBUG - Processing node 69fd868c197af08e45fc7483: baseline-arm-baylibre 2026-05-10 06:45:36,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd868c197af08e45fc7483 2026-05-10 06:45:36,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:36,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd868c197af08e45fc7483 HTTP/1.1" 200 None 2026-05-10 06:45:36,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:36,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:45:36,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:45:36,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd868c197af08e45fc7483 HTTP/1.1" 200 None 2026-05-10 06:45:36,123 - lava_callback - ERROR - Error processing callback for node 69fd868c197af08e45fc7483: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36300 - "GET /api/metrics HTTP/1.0" 200 OK 2026-05-10 06:46:16,090 - lava_callback - INFO - Received callback for node 69fd86b1197af08e45fc7494 INFO: 172.20.0.1:36316 - "POST /node/69fd86b1197af08e45fc7494 HTTP/1.0" 202 Accepted 2026-05-10 06:46:16,096 - lava_callback - INFO - Starting async job submit for node 69fd86b1197af08e45fc7494 2026-05-10 06:46:16,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:16,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd86b1197af08e45fc7494 HTTP/1.1" 200 None 2026-05-10 06:46:16,111 - lava_callback - DEBUG - Processing node 69fd86b1197af08e45fc7494: baseline-arm-baylibre 2026-05-10 06:46:16,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd86b1197af08e45fc7494 2026-05-10 06:46:16,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:16,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd86b1197af08e45fc7494 HTTP/1.1" 200 None 2026-05-10 06:46:16,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:16,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:46:16,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:16,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd86b1197af08e45fc7494 HTTP/1.1" 200 None 2026-05-10 06:46:16,159 - lava_callback - ERROR - Error processing callback for node 69fd86b1197af08e45fc7494: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49890 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:46:56,353 - lava_callback - INFO - Received callback for node 69fd86d6197af08e45fc74a7 INFO: 172.20.0.1:51522 - "POST /node/69fd86d6197af08e45fc74a7 HTTP/1.0" 202 Accepted 2026-05-10 06:46:56,358 - lava_callback - INFO - Starting async job submit for node 69fd86d6197af08e45fc74a7 2026-05-10 06:46:56,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:56,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd86d6197af08e45fc74a7 HTTP/1.1" 200 None 2026-05-10 06:46:56,379 - lava_callback - DEBUG - Processing node 69fd86d6197af08e45fc74a7: baseline-arm-baylibre 2026-05-10 06:46:56,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd86d6197af08e45fc74a7 2026-05-10 06:46:56,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:56,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd86d6197af08e45fc74a7 HTTP/1.1" 200 None 2026-05-10 06:46:56,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:56,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:46:56,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:46:56,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd86d6197af08e45fc74a7 HTTP/1.1" 200 None 2026-05-10 06:46:56,424 - lava_callback - ERROR - Error processing callback for node 69fd86d6197af08e45fc74a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42322 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:47:36,173 - lava_callback - INFO - Received callback for node 69fd86fb197af08e45fc74b6 INFO: 172.20.0.1:58452 - "POST /node/69fd86fb197af08e45fc74b6 HTTP/1.0" 202 Accepted 2026-05-10 06:47:36,179 - lava_callback - INFO - Starting async job submit for node 69fd86fb197af08e45fc74b6 2026-05-10 06:47:36,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:47:36,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd86fb197af08e45fc74b6 HTTP/1.1" 200 None 2026-05-10 06:47:36,214 - lava_callback - DEBUG - Processing node 69fd86fb197af08e45fc74b6: baseline-arm-baylibre 2026-05-10 06:47:36,215 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd86fb197af08e45fc74b6 2026-05-10 06:47:36,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:47:36,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd86fb197af08e45fc74b6 HTTP/1.1" 200 None 2026-05-10 06:47:36,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:47:36,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:47:36,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:47:36,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd86fb197af08e45fc74b6 HTTP/1.1" 200 None 2026-05-10 06:47:36,271 - lava_callback - ERROR - Error processing callback for node 69fd86fb197af08e45fc74b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51556 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:49:26,162 - lava_callback - INFO - Received callback for node 69fd8768197af08e45fc74f1 INFO: 172.20.0.1:34776 - "POST /node/69fd8768197af08e45fc74f1 HTTP/1.0" 202 Accepted 2026-05-10 06:49:26,167 - lava_callback - INFO - Starting async job submit for node 69fd8768197af08e45fc74f1 2026-05-10 06:49:26,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:49:26,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8768197af08e45fc74f1 HTTP/1.1" 200 None 2026-05-10 06:49:26,190 - lava_callback - DEBUG - Processing node 69fd8768197af08e45fc74f1: baseline-arm-clabbe 2026-05-10 06:49:26,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8768197af08e45fc74f1 2026-05-10 06:49:26,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:49:26,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8768197af08e45fc74f1 HTTP/1.1" 200 None 2026-05-10 06:49:26,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:49:26,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:49:26,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:49:26,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8768197af08e45fc74f1 HTTP/1.1" 200 None 2026-05-10 06:49:26,242 - lava_callback - ERROR - Error processing callback for node 69fd8768197af08e45fc74f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35446 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:50:05,941 - lava_callback - INFO - Received callback for node 69fd878f197af08e45fc7503 INFO: 172.20.0.1:42314 - "POST /node/69fd878f197af08e45fc7503 HTTP/1.0" 202 Accepted 2026-05-10 06:50:05,947 - lava_callback - INFO - Starting async job submit for node 69fd878f197af08e45fc7503 2026-05-10 06:50:05,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:05,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd878f197af08e45fc7503 HTTP/1.1" 200 None 2026-05-10 06:50:05,961 - lava_callback - DEBUG - Processing node 69fd878f197af08e45fc7503: baseline-arm-clabbe 2026-05-10 06:50:05,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd878f197af08e45fc7503 2026-05-10 06:50:05,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:05,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd878f197af08e45fc7503 HTTP/1.1" 200 None 2026-05-10 06:50:05,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:50:05,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:06,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd878f197af08e45fc7503 HTTP/1.1" 200 None 2026-05-10 06:50:06,006 - lava_callback - ERROR - Error processing callback for node 69fd878f197af08e45fc7503: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44906 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:50:45,964 - lava_callback - INFO - Received callback for node 69fd87b5197af08e45fc7518 INFO: 172.20.0.1:54060 - "POST /node/69fd87b5197af08e45fc7518 HTTP/1.0" 202 Accepted 2026-05-10 06:50:45,970 - lava_callback - INFO - Starting async job submit for node 69fd87b5197af08e45fc7518 2026-05-10 06:50:45,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:45,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd87b5197af08e45fc7518 HTTP/1.1" 200 None 2026-05-10 06:50:45,985 - lava_callback - DEBUG - Processing node 69fd87b5197af08e45fc7518: baseline-arm-clabbe 2026-05-10 06:50:45,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd87b5197af08e45fc7518 2026-05-10 06:50:45,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:46,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd87b5197af08e45fc7518 HTTP/1.1" 200 None 2026-05-10 06:50:46,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:46,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:50:46,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:50:46,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd87b5197af08e45fc7518 HTTP/1.1" 200 None 2026-05-10 06:50:46,035 - lava_callback - ERROR - Error processing callback for node 69fd87b5197af08e45fc7518: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32802 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:51:25,922 - lava_callback - INFO - Received callback for node 69fd87db197af08e45fc752e INFO: 172.20.0.1:55374 - "POST /node/69fd87db197af08e45fc752e HTTP/1.0" 202 Accepted 2026-05-10 06:51:25,928 - lava_callback - INFO - Starting async job submit for node 69fd87db197af08e45fc752e 2026-05-10 06:51:25,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:51:25,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd87db197af08e45fc752e HTTP/1.1" 200 None 2026-05-10 06:51:25,944 - lava_callback - DEBUG - Processing node 69fd87db197af08e45fc752e: baseline-arm-clabbe 2026-05-10 06:51:25,944 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd87db197af08e45fc752e 2026-05-10 06:51:25,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:51:25,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd87db197af08e45fc752e HTTP/1.1" 200 None 2026-05-10 06:51:25,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:51:25,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:51:25,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:51:25,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd87db197af08e45fc752e HTTP/1.1" 200 None 2026-05-10 06:51:25,995 - lava_callback - ERROR - Error processing callback for node 69fd87db197af08e45fc752e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46576 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:52:06,025 - lava_callback - INFO - Received callback for node 69fd8801197af08e45fc7549 INFO: 172.20.0.1:44968 - "POST /node/69fd8801197af08e45fc7549 HTTP/1.0" 202 Accepted 2026-05-10 06:52:06,031 - lava_callback - INFO - Starting async job submit for node 69fd8801197af08e45fc7549 2026-05-10 06:52:06,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:06,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8801197af08e45fc7549 HTTP/1.1" 200 None 2026-05-10 06:52:06,046 - lava_callback - DEBUG - Processing node 69fd8801197af08e45fc7549: baseline-arm-clabbe 2026-05-10 06:52:06,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8801197af08e45fc7549 2026-05-10 06:52:06,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:06,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8801197af08e45fc7549 HTTP/1.1" 200 None 2026-05-10 06:52:06,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:06,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:52:06,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:06,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8801197af08e45fc7549 HTTP/1.1" 200 None 2026-05-10 06:52:06,092 - lava_callback - ERROR - Error processing callback for node 69fd8801197af08e45fc7549: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58932 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:52:45,980 - lava_callback - INFO - Received callback for node 69fd8828197af08e45fc7553 INFO: 172.20.0.1:51734 - "POST /node/69fd8828197af08e45fc7553 HTTP/1.0" 202 Accepted 2026-05-10 06:52:45,985 - lava_callback - INFO - Starting async job submit for node 69fd8828197af08e45fc7553 2026-05-10 06:52:45,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:46,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8828197af08e45fc7553 HTTP/1.1" 200 None 2026-05-10 06:52:46,001 - lava_callback - DEBUG - Processing node 69fd8828197af08e45fc7553: baseline-arm-clabbe 2026-05-10 06:52:46,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8828197af08e45fc7553 2026-05-10 06:52:46,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:46,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8828197af08e45fc7553 HTTP/1.1" 200 None 2026-05-10 06:52:46,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:46,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 06:52:46,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:52:46,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8828197af08e45fc7553 HTTP/1.1" 200 None 2026-05-10 06:52:46,047 - lava_callback - ERROR - Error processing callback for node 69fd8828197af08e45fc7553: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51944 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:53:06,005 - lava_callback - INFO - Received callback for node 69fd884d197af08e45fc7567 INFO: 172.20.0.1:46188 - "POST /node/69fd884d197af08e45fc7567 HTTP/1.0" 202 Accepted 2026-05-10 06:53:06,011 - lava_callback - INFO - Starting async job submit for node 69fd884d197af08e45fc7567 2026-05-10 06:53:06,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:06,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd884d197af08e45fc7567 HTTP/1.1" 200 None 2026-05-10 06:53:06,025 - lava_callback - DEBUG - Processing node 69fd884d197af08e45fc7567: baseline-arm-clabbe 2026-05-10 06:53:06,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd884d197af08e45fc7567 2026-05-10 06:53:06,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:06,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd884d197af08e45fc7567 HTTP/1.1" 200 None 2026-05-10 06:53:06,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:06,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bf2197af08e45fc2dcf HTTP/1.1" 200 None 2026-05-10 06:53:06,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:06,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd884d197af08e45fc7567 HTTP/1.1" 200 None 2026-05-10 06:53:06,071 - lava_callback - ERROR - Error processing callback for node 69fd884d197af08e45fc7567: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56020 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:53:46,060 - lava_callback - INFO - Received callback for node 69fd8872197af08e45fc7577 INFO: 172.20.0.1:58240 - "POST /node/69fd8872197af08e45fc7577 HTTP/1.0" 202 Accepted 2026-05-10 06:53:46,065 - lava_callback - INFO - Starting async job submit for node 69fd8872197af08e45fc7577 2026-05-10 06:53:46,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:46,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8872197af08e45fc7577 HTTP/1.1" 200 None 2026-05-10 06:53:46,081 - lava_callback - DEBUG - Processing node 69fd8872197af08e45fc7577: baseline-arm-clabbe 2026-05-10 06:53:46,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8872197af08e45fc7577 2026-05-10 06:53:46,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:46,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8872197af08e45fc7577 HTTP/1.1" 200 None 2026-05-10 06:53:46,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:46,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 06:53:46,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:53:46,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8872197af08e45fc7577 HTTP/1.1" 200 None 2026-05-10 06:53:46,126 - lava_callback - ERROR - Error processing callback for node 69fd8872197af08e45fc7577: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39844 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:54:16,655 - lava_callback - INFO - Received callback for node 69fd8893197af08e45fc7587 INFO: 172.20.0.1:39858 - "POST /node/69fd8893197af08e45fc7587 HTTP/1.0" 202 Accepted 2026-05-10 06:54:16,660 - lava_callback - INFO - Starting async job submit for node 69fd8893197af08e45fc7587 2026-05-10 06:54:16,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:54:16,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8893197af08e45fc7587 HTTP/1.1" 200 None 2026-05-10 06:54:16,679 - lava_callback - DEBUG - Processing node 69fd8893197af08e45fc7587: baseline-arm-baylibre 2026-05-10 06:54:16,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8893197af08e45fc7587 2026-05-10 06:54:16,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:54:16,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8893197af08e45fc7587 HTTP/1.1" 200 None 2026-05-10 06:54:16,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:54:16,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 06:54:16,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:54:16,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8893197af08e45fc7587 HTTP/1.1" 200 None 2026-05-10 06:54:16,729 - lava_callback - ERROR - Error processing callback for node 69fd8893197af08e45fc7587: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55116 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:57:26,195 - lava_callback - INFO - Received callback for node 69fd894d197af08e45fc75d0 INFO: 172.20.0.1:40974 - "POST /node/69fd894d197af08e45fc75d0 HTTP/1.0" 202 Accepted 2026-05-10 06:57:26,201 - lava_callback - INFO - Starting async job submit for node 69fd894d197af08e45fc75d0 2026-05-10 06:57:26,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:57:26,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd894d197af08e45fc75d0 HTTP/1.1" 200 None 2026-05-10 06:57:26,220 - lava_callback - DEBUG - Processing node 69fd894d197af08e45fc75d0: baseline-arm-clabbe 2026-05-10 06:57:26,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd894d197af08e45fc75d0 2026-05-10 06:57:26,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:57:26,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd894d197af08e45fc75d0 HTTP/1.1" 200 None 2026-05-10 06:57:26,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:57:26,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 06:57:26,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:57:26,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd894d197af08e45fc75d0 HTTP/1.1" 200 None 2026-05-10 06:57:26,270 - lava_callback - ERROR - Error processing callback for node 69fd894d197af08e45fc75d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41492 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:58:06,170 - lava_callback - INFO - Received callback for node 69fd8975197af08e45fc75db INFO: 172.20.0.1:38602 - "POST /node/69fd8975197af08e45fc75db HTTP/1.0" 202 Accepted 2026-05-10 06:58:06,176 - lava_callback - INFO - Starting async job submit for node 69fd8975197af08e45fc75db 2026-05-10 06:58:06,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:06,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8975197af08e45fc75db HTTP/1.1" 200 None 2026-05-10 06:58:06,192 - lava_callback - DEBUG - Processing node 69fd8975197af08e45fc75db: baseline-arm-clabbe 2026-05-10 06:58:06,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8975197af08e45fc75db 2026-05-10 06:58:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:06,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8975197af08e45fc75db HTTP/1.1" 200 None 2026-05-10 06:58:06,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:06,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 06:58:06,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:06,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8975197af08e45fc75db HTTP/1.1" 200 None 2026-05-10 06:58:06,244 - lava_callback - ERROR - Error processing callback for node 69fd8975197af08e45fc75db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45804 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:58:46,202 - lava_callback - INFO - Received callback for node 69fd899d197af08e45fc75ee INFO: 172.20.0.1:51706 - "POST /node/69fd899d197af08e45fc75ee HTTP/1.0" 202 Accepted 2026-05-10 06:58:46,208 - lava_callback - INFO - Starting async job submit for node 69fd899d197af08e45fc75ee 2026-05-10 06:58:46,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:46,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd899d197af08e45fc75ee HTTP/1.1" 200 None 2026-05-10 06:58:46,222 - lava_callback - DEBUG - Processing node 69fd899d197af08e45fc75ee: baseline-arm-clabbe 2026-05-10 06:58:46,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd899d197af08e45fc75ee 2026-05-10 06:58:46,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:46,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd899d197af08e45fc75ee HTTP/1.1" 200 None 2026-05-10 06:58:46,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:46,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 06:58:46,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:58:46,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd899d197af08e45fc75ee HTTP/1.1" 200 None 2026-05-10 06:58:46,269 - lava_callback - ERROR - Error processing callback for node 69fd899d197af08e45fc75ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42436 - "GET / HTTP/1.0" 200 OK 2026-05-10 06:59:26,227 - lava_callback - INFO - Received callback for node 69fd89c5197af08e45fc75ff INFO: 172.20.0.1:40770 - "POST /node/69fd89c5197af08e45fc75ff HTTP/1.0" 202 Accepted 2026-05-10 06:59:26,232 - lava_callback - INFO - Starting async job submit for node 69fd89c5197af08e45fc75ff 2026-05-10 06:59:26,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:59:26,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd89c5197af08e45fc75ff HTTP/1.1" 200 None 2026-05-10 06:59:26,248 - lava_callback - DEBUG - Processing node 69fd89c5197af08e45fc75ff: baseline-arm-clabbe 2026-05-10 06:59:26,248 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd89c5197af08e45fc75ff 2026-05-10 06:59:26,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:59:26,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd89c5197af08e45fc75ff HTTP/1.1" 200 None 2026-05-10 06:59:26,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:59:26,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 06:59:26,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 06:59:26,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd89c5197af08e45fc75ff HTTP/1.1" 200 None 2026-05-10 06:59:26,298 - lava_callback - ERROR - Error processing callback for node 69fd89c5197af08e45fc75ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51810 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:00:06,482 - lava_callback - INFO - Received callback for node 69fd89ec197af08e45fc760a INFO: 172.20.0.1:41370 - "POST /node/69fd89ec197af08e45fc760a HTTP/1.0" 202 Accepted 2026-05-10 07:00:06,488 - lava_callback - INFO - Starting async job submit for node 69fd89ec197af08e45fc760a 2026-05-10 07:00:06,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:00:06,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd89ec197af08e45fc760a HTTP/1.1" 200 None 2026-05-10 07:00:06,504 - lava_callback - DEBUG - Processing node 69fd89ec197af08e45fc760a: baseline-arm-clabbe 2026-05-10 07:00:06,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd89ec197af08e45fc760a 2026-05-10 07:00:06,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:41376 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:00:06,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd89ec197af08e45fc760a HTTP/1.1" 200 None 2026-05-10 07:00:06,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:00:06,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:00:06,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:00:06,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd89ec197af08e45fc760a HTTP/1.1" 200 None 2026-05-10 07:00:06,550 - lava_callback - ERROR - Error processing callback for node 69fd89ec197af08e45fc760a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:00:46,272 - lava_callback - INFO - Received callback for node 69fd8a15197af08e45fc761c INFO: 172.20.0.1:34892 - "POST /node/69fd8a15197af08e45fc761c HTTP/1.0" 202 Accepted 2026-05-10 07:00:46,281 - lava_callback - INFO - Starting async job submit for node 69fd8a15197af08e45fc761c 2026-05-10 07:00:46,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:00:46,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a15197af08e45fc761c HTTP/1.1" 200 None 2026-05-10 07:00:46,295 - lava_callback - DEBUG - Processing node 69fd8a15197af08e45fc761c: baseline-arm-clabbe 2026-05-10 07:00:46,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8a15197af08e45fc761c 2026-05-10 07:00:46,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:00:46,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a15197af08e45fc761c HTTP/1.1" 200 None 2026-05-10 07:00:46,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:00:46,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:00:46,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:00:46,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8a15197af08e45fc761c HTTP/1.1" 200 None 2026-05-10 07:00:46,362 - lava_callback - ERROR - Error processing callback for node 69fd8a15197af08e45fc761c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37282 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:01:26,358 - lava_callback - INFO - Received callback for node 69fd8a3d197af08e45fc762e INFO: 172.20.0.1:38038 - "POST /node/69fd8a3d197af08e45fc762e HTTP/1.0" 202 Accepted 2026-05-10 07:01:26,364 - lava_callback - INFO - Starting async job submit for node 69fd8a3d197af08e45fc762e 2026-05-10 07:01:26,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:01:26,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a3d197af08e45fc762e HTTP/1.1" 200 None 2026-05-10 07:01:26,379 - lava_callback - DEBUG - Processing node 69fd8a3d197af08e45fc762e: baseline-arm-clabbe 2026-05-10 07:01:26,380 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8a3d197af08e45fc762e 2026-05-10 07:01:26,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:01:26,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a3d197af08e45fc762e HTTP/1.1" 200 None 2026-05-10 07:01:26,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:01:26,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:01:26,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:01:26,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8a3d197af08e45fc762e HTTP/1.1" 200 None 2026-05-10 07:01:26,427 - lava_callback - ERROR - Error processing callback for node 69fd8a3d197af08e45fc762e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46336 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:02:06,354 - lava_callback - INFO - Received callback for node 69fd8a64197af08e45fc763a INFO: 172.20.0.1:56664 - "POST /node/69fd8a64197af08e45fc763a HTTP/1.0" 202 Accepted 2026-05-10 07:02:06,359 - lava_callback - INFO - Starting async job submit for node 69fd8a64197af08e45fc763a 2026-05-10 07:02:06,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:06,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a64197af08e45fc763a HTTP/1.1" 200 None 2026-05-10 07:02:06,374 - lava_callback - DEBUG - Processing node 69fd8a64197af08e45fc763a: baseline-arm-clabbe 2026-05-10 07:02:06,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8a64197af08e45fc763a 2026-05-10 07:02:06,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:06,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a64197af08e45fc763a HTTP/1.1" 200 None 2026-05-10 07:02:06,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:06,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:02:06,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:06,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8a64197af08e45fc763a HTTP/1.1" 200 None 2026-05-10 07:02:06,418 - lava_callback - ERROR - Error processing callback for node 69fd8a64197af08e45fc763a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54854 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:02:46,393 - lava_callback - INFO - Received callback for node 69fd8a8d197af08e45fc7649 INFO: 172.20.0.1:47824 - "POST /node/69fd8a8d197af08e45fc7649 HTTP/1.0" 202 Accepted 2026-05-10 07:02:46,399 - lava_callback - INFO - Starting async job submit for node 69fd8a8d197af08e45fc7649 2026-05-10 07:02:46,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:46,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a8d197af08e45fc7649 HTTP/1.1" 200 None 2026-05-10 07:02:46,415 - lava_callback - DEBUG - Processing node 69fd8a8d197af08e45fc7649: baseline-arm-clabbe 2026-05-10 07:02:46,415 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8a8d197af08e45fc7649 2026-05-10 07:02:46,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:46,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8a8d197af08e45fc7649 HTTP/1.1" 200 None 2026-05-10 07:02:46,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:46,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:02:46,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:02:46,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8a8d197af08e45fc7649 HTTP/1.1" 200 None 2026-05-10 07:02:46,473 - lava_callback - ERROR - Error processing callback for node 69fd8a8d197af08e45fc7649: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38982 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:03:26,394 - lava_callback - INFO - Received callback for node 69fd8ab7197af08e45fc765d INFO: 172.20.0.1:60396 - "POST /node/69fd8ab7197af08e45fc765d HTTP/1.0" 202 Accepted 2026-05-10 07:03:26,403 - lava_callback - INFO - Starting async job submit for node 69fd8ab7197af08e45fc765d 2026-05-10 07:03:26,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:03:26,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ab7197af08e45fc765d HTTP/1.1" 200 None 2026-05-10 07:03:26,420 - lava_callback - DEBUG - Processing node 69fd8ab7197af08e45fc765d: baseline-arm-clabbe 2026-05-10 07:03:26,420 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8ab7197af08e45fc765d 2026-05-10 07:03:26,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:03:26,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ab7197af08e45fc765d HTTP/1.1" 200 None 2026-05-10 07:03:26,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:03:26,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:03:26,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:03:26,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8ab7197af08e45fc765d HTTP/1.1" 200 None 2026-05-10 07:03:26,464 - lava_callback - ERROR - Error processing callback for node 69fd8ab7197af08e45fc765d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40862 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:04:06,421 - lava_callback - INFO - Received callback for node 69fd8add197af08e45fc7667 INFO: 172.20.0.1:57496 - "POST /node/69fd8add197af08e45fc7667 HTTP/1.0" 202 Accepted 2026-05-10 07:04:06,427 - lava_callback - INFO - Starting async job submit for node 69fd8add197af08e45fc7667 2026-05-10 07:04:06,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:06,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8add197af08e45fc7667 HTTP/1.1" 200 None 2026-05-10 07:04:06,442 - lava_callback - DEBUG - Processing node 69fd8add197af08e45fc7667: baseline-arm-clabbe 2026-05-10 07:04:06,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8add197af08e45fc7667 2026-05-10 07:04:06,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:06,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8add197af08e45fc7667 HTTP/1.1" 200 None 2026-05-10 07:04:06,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:06,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:04:06,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:06,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8add197af08e45fc7667 HTTP/1.1" 200 None 2026-05-10 07:04:06,493 - lava_callback - ERROR - Error processing callback for node 69fd8add197af08e45fc7667: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44230 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:04:46,417 - lava_callback - INFO - Received callback for node 69fd8b04197af08e45fc7673 INFO: 172.20.0.1:53738 - "POST /node/69fd8b04197af08e45fc7673 HTTP/1.0" 202 Accepted 2026-05-10 07:04:46,422 - lava_callback - INFO - Starting async job submit for node 69fd8b04197af08e45fc7673 2026-05-10 07:04:46,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:46,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8b04197af08e45fc7673 HTTP/1.1" 200 None 2026-05-10 07:04:46,444 - lava_callback - DEBUG - Processing node 69fd8b04197af08e45fc7673: baseline-arm-clabbe 2026-05-10 07:04:46,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8b04197af08e45fc7673 2026-05-10 07:04:46,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:46,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8b04197af08e45fc7673 HTTP/1.1" 200 None 2026-05-10 07:04:46,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:46,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8888e18d38d4ebffe6fe HTTP/1.1" 200 None 2026-05-10 07:04:46,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:04:46,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8b04197af08e45fc7673 HTTP/1.1" 200 None 2026-05-10 07:04:46,490 - lava_callback - ERROR - Error processing callback for node 69fd8b04197af08e45fc7673: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60012 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:05:17,282 - lava_callback - INFO - Received callback for node 69fd8b24197af08e45fc768b INFO: 172.20.0.1:60018 - "POST /node/69fd8b24197af08e45fc768b HTTP/1.0" 202 Accepted 2026-05-10 07:05:17,288 - lava_callback - INFO - Starting async job submit for node 69fd8b24197af08e45fc768b 2026-05-10 07:05:17,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:17,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8b24197af08e45fc768b HTTP/1.1" 200 None 2026-05-10 07:05:17,309 - lava_callback - DEBUG - Processing node 69fd8b24197af08e45fc768b: baseline-arm-baylibre 2026-05-10 07:05:17,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8b24197af08e45fc768b 2026-05-10 07:05:17,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:17,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8b24197af08e45fc768b HTTP/1.1" 200 None 2026-05-10 07:05:17,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:17,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:05:17,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:17,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8b24197af08e45fc768b HTTP/1.1" 200 None 2026-05-10 07:05:17,357 - lava_callback - ERROR - Error processing callback for node 69fd8b24197af08e45fc768b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37632 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:05:57,232 - lava_callback - INFO - Received callback for node 69fd8b4d197af08e45fc76a2 INFO: 172.20.0.1:37642 - "POST /node/69fd8b4d197af08e45fc76a2 HTTP/1.0" 202 Accepted 2026-05-10 07:05:57,238 - lava_callback - INFO - Starting async job submit for node 69fd8b4d197af08e45fc76a2 2026-05-10 07:05:57,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:57,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8b4d197af08e45fc76a2 HTTP/1.1" 200 None 2026-05-10 07:05:57,253 - lava_callback - DEBUG - Processing node 69fd8b4d197af08e45fc76a2: baseline-arm-baylibre 2026-05-10 07:05:57,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8b4d197af08e45fc76a2 2026-05-10 07:05:57,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:57,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8b4d197af08e45fc76a2 HTTP/1.1" 200 None 2026-05-10 07:05:57,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:57,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:05:57,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:05:57,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8b4d197af08e45fc76a2 HTTP/1.1" 200 None 2026-05-10 07:05:57,298 - lava_callback - ERROR - Error processing callback for node 69fd8b4d197af08e45fc76a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60280 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:07:57,451 - lava_callback - INFO - Received callback for node 69fd8bbd197af08e45fc76cd INFO: 172.20.0.1:60292 - "POST /node/69fd8bbd197af08e45fc76cd HTTP/1.0" 202 Accepted 2026-05-10 07:07:57,457 - lava_callback - INFO - Starting async job submit for node 69fd8bbd197af08e45fc76cd 2026-05-10 07:07:57,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:07:57,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8bbd197af08e45fc76cd HTTP/1.1" 200 None 2026-05-10 07:07:57,472 - lava_callback - DEBUG - Processing node 69fd8bbd197af08e45fc76cd: baseline-arm-baylibre 2026-05-10 07:07:57,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8bbd197af08e45fc76cd 2026-05-10 07:07:57,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:07:57,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8bbd197af08e45fc76cd HTTP/1.1" 200 None 2026-05-10 07:07:57,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:07:57,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:07:57,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:07:57,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8bbd197af08e45fc76cd HTTP/1.1" 200 None 2026-05-10 07:07:57,533 - lava_callback - ERROR - Error processing callback for node 69fd8bbd197af08e45fc76cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41348 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:08:37,360 - lava_callback - INFO - Received callback for node 69fd8be1197af08e45fc76da INFO: 172.20.0.1:41350 - "POST /node/69fd8be1197af08e45fc76da HTTP/1.0" 202 Accepted 2026-05-10 07:08:37,366 - lava_callback - INFO - Starting async job submit for node 69fd8be1197af08e45fc76da 2026-05-10 07:08:37,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:08:37,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8be1197af08e45fc76da HTTP/1.1" 200 None 2026-05-10 07:08:37,382 - lava_callback - DEBUG - Processing node 69fd8be1197af08e45fc76da: baseline-arm-baylibre 2026-05-10 07:08:37,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8be1197af08e45fc76da 2026-05-10 07:08:37,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:08:37,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8be1197af08e45fc76da HTTP/1.1" 200 None 2026-05-10 07:08:37,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:08:37,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:08:37,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:08:37,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8be1197af08e45fc76da HTTP/1.1" 200 None 2026-05-10 07:08:37,448 - lava_callback - ERROR - Error processing callback for node 69fd8be1197af08e45fc76da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53916 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:09:37,606 - lava_callback - INFO - Received callback for node 69fd8c2b197af08e45fc76ef INFO: 172.20.0.1:53928 - "POST /node/69fd8c2b197af08e45fc76ef HTTP/1.0" 202 Accepted 2026-05-10 07:09:37,612 - lava_callback - INFO - Starting async job submit for node 69fd8c2b197af08e45fc76ef 2026-05-10 07:09:37,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:09:37,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c2b197af08e45fc76ef HTTP/1.1" 200 None 2026-05-10 07:09:37,627 - lava_callback - DEBUG - Processing node 69fd8c2b197af08e45fc76ef: baseline-arm-baylibre 2026-05-10 07:09:37,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8c2b197af08e45fc76ef 2026-05-10 07:09:37,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:09:37,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c2b197af08e45fc76ef HTTP/1.1" 200 None 2026-05-10 07:09:37,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:09:37,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:09:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:09:37,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8c2b197af08e45fc76ef HTTP/1.1" 200 None 2026-05-10 07:09:37,683 - lava_callback - ERROR - Error processing callback for node 69fd8c2b197af08e45fc76ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41076 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:10:17,449 - lava_callback - INFO - Received callback for node 69fd8c4f197af08e45fc76fc INFO: 172.20.0.1:41090 - "POST /node/69fd8c4f197af08e45fc76fc HTTP/1.0" 202 Accepted 2026-05-10 07:10:17,454 - lava_callback - INFO - Starting async job submit for node 69fd8c4f197af08e45fc76fc 2026-05-10 07:10:17,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:17,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c4f197af08e45fc76fc HTTP/1.1" 200 None 2026-05-10 07:10:17,470 - lava_callback - DEBUG - Processing node 69fd8c4f197af08e45fc76fc: baseline-arm-baylibre 2026-05-10 07:10:17,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8c4f197af08e45fc76fc 2026-05-10 07:10:17,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:17,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c4f197af08e45fc76fc HTTP/1.1" 200 None 2026-05-10 07:10:17,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:17,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:10:17,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:17,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8c4f197af08e45fc76fc HTTP/1.1" 200 None 2026-05-10 07:10:17,516 - lava_callback - ERROR - Error processing callback for node 69fd8c4f197af08e45fc76fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51444 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:10:57,575 - lava_callback - INFO - Received callback for node 69fd8c74197af08e45fc770b INFO: 172.20.0.1:51452 - "POST /node/69fd8c74197af08e45fc770b HTTP/1.0" 202 Accepted 2026-05-10 07:10:57,581 - lava_callback - INFO - Starting async job submit for node 69fd8c74197af08e45fc770b 2026-05-10 07:10:57,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:57,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c74197af08e45fc770b HTTP/1.1" 200 None 2026-05-10 07:10:57,596 - lava_callback - DEBUG - Processing node 69fd8c74197af08e45fc770b: baseline-arm-baylibre 2026-05-10 07:10:57,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8c74197af08e45fc770b 2026-05-10 07:10:57,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:57,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c74197af08e45fc770b HTTP/1.1" 200 None 2026-05-10 07:10:57,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:57,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:10:57,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:10:57,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8c74197af08e45fc770b HTTP/1.1" 200 None 2026-05-10 07:10:57,641 - lava_callback - ERROR - Error processing callback for node 69fd8c74197af08e45fc770b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42966 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:11:37,556 - lava_callback - INFO - Received callback for node 69fd8c97197af08e45fc7719 INFO: 172.20.0.1:42978 - "POST /node/69fd8c97197af08e45fc7719 HTTP/1.0" 202 Accepted 2026-05-10 07:11:37,562 - lava_callback - INFO - Starting async job submit for node 69fd8c97197af08e45fc7719 2026-05-10 07:11:37,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:11:37,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c97197af08e45fc7719 HTTP/1.1" 200 None 2026-05-10 07:11:37,579 - lava_callback - DEBUG - Processing node 69fd8c97197af08e45fc7719: baseline-arm-baylibre 2026-05-10 07:11:37,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8c97197af08e45fc7719 2026-05-10 07:11:37,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:11:37,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8c97197af08e45fc7719 HTTP/1.1" 200 None 2026-05-10 07:11:37,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:11:37,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:11:37,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:11:37,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8c97197af08e45fc7719 HTTP/1.1" 200 None 2026-05-10 07:11:37,625 - lava_callback - ERROR - Error processing callback for node 69fd8c97197af08e45fc7719: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56512 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:12:17,608 - lava_callback - INFO - Received callback for node 69fd8cbc197af08e45fc7726 INFO: 172.20.0.1:56524 - "POST /node/69fd8cbc197af08e45fc7726 HTTP/1.0" 202 Accepted 2026-05-10 07:12:17,614 - lava_callback - INFO - Starting async job submit for node 69fd8cbc197af08e45fc7726 2026-05-10 07:12:17,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:17,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8cbc197af08e45fc7726 HTTP/1.1" 200 None 2026-05-10 07:12:17,629 - lava_callback - DEBUG - Processing node 69fd8cbc197af08e45fc7726: baseline-arm-baylibre 2026-05-10 07:12:17,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8cbc197af08e45fc7726 2026-05-10 07:12:17,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:17,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8cbc197af08e45fc7726 HTTP/1.1" 200 None 2026-05-10 07:12:17,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:17,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:12:17,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:17,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8cbc197af08e45fc7726 HTTP/1.1" 200 None 2026-05-10 07:12:17,678 - lava_callback - ERROR - Error processing callback for node 69fd8cbc197af08e45fc7726: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43656 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:12:37,605 - lava_callback - INFO - Received callback for node 69fd8ce2197af08e45fc7734 INFO: 172.20.0.1:43658 - "POST /node/69fd8ce2197af08e45fc7734 HTTP/1.0" 202 Accepted 2026-05-10 07:12:37,611 - lava_callback - INFO - Starting async job submit for node 69fd8ce2197af08e45fc7734 2026-05-10 07:12:37,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:37,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ce2197af08e45fc7734 HTTP/1.1" 200 None 2026-05-10 07:12:37,654 - lava_callback - DEBUG - Processing node 69fd8ce2197af08e45fc7734: baseline-arm-baylibre 2026-05-10 07:12:37,654 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8ce2197af08e45fc7734 2026-05-10 07:12:37,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:37,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ce2197af08e45fc7734 HTTP/1.1" 200 None 2026-05-10 07:12:37,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:37,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:12:37,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:12:37,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8ce2197af08e45fc7734 HTTP/1.1" 200 None 2026-05-10 07:12:37,701 - lava_callback - ERROR - Error processing callback for node 69fd8ce2197af08e45fc7734: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44490 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:13:17,619 - lava_callback - INFO - Received callback for node 69fd8d07197af08e45fc7744 INFO: 172.20.0.1:44506 - "POST /node/69fd8d07197af08e45fc7744 HTTP/1.0" 202 Accepted 2026-05-10 07:13:17,624 - lava_callback - INFO - Starting async job submit for node 69fd8d07197af08e45fc7744 2026-05-10 07:13:17,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:17,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d07197af08e45fc7744 HTTP/1.1" 200 None 2026-05-10 07:13:17,640 - lava_callback - DEBUG - Processing node 69fd8d07197af08e45fc7744: baseline-arm-baylibre 2026-05-10 07:13:17,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8d07197af08e45fc7744 2026-05-10 07:13:17,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:17,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d07197af08e45fc7744 HTTP/1.1" 200 None 2026-05-10 07:13:17,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:17,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:13:17,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:17,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8d07197af08e45fc7744 HTTP/1.1" 200 None 2026-05-10 07:13:17,698 - lava_callback - ERROR - Error processing callback for node 69fd8d07197af08e45fc7744: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41626 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:13:57,717 - lava_callback - INFO - Received callback for node 69fd8d2b197af08e45fc7758 INFO: 172.20.0.1:41628 - "POST /node/69fd8d2b197af08e45fc7758 HTTP/1.0" 202 Accepted 2026-05-10 07:13:57,723 - lava_callback - INFO - Starting async job submit for node 69fd8d2b197af08e45fc7758 2026-05-10 07:13:57,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:57,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d2b197af08e45fc7758 HTTP/1.1" 200 None 2026-05-10 07:13:57,739 - lava_callback - DEBUG - Processing node 69fd8d2b197af08e45fc7758: baseline-arm-baylibre 2026-05-10 07:13:57,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8d2b197af08e45fc7758 2026-05-10 07:13:57,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:57,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d2b197af08e45fc7758 HTTP/1.1" 200 None 2026-05-10 07:13:57,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:57,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:13:57,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:13:57,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8d2b197af08e45fc7758 HTTP/1.1" 200 None 2026-05-10 07:13:57,787 - lava_callback - ERROR - Error processing callback for node 69fd8d2b197af08e45fc7758: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60158 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:14:37,707 - lava_callback - INFO - Received callback for node 69fd8d50197af08e45fc7764 INFO: 172.20.0.1:60162 - "POST /node/69fd8d50197af08e45fc7764 HTTP/1.0" 202 Accepted 2026-05-10 07:14:37,714 - lava_callback - INFO - Starting async job submit for node 69fd8d50197af08e45fc7764 2026-05-10 07:14:37,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:14:37,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d50197af08e45fc7764 HTTP/1.1" 200 None 2026-05-10 07:14:37,730 - lava_callback - DEBUG - Processing node 69fd8d50197af08e45fc7764: baseline-arm-baylibre 2026-05-10 07:14:37,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8d50197af08e45fc7764 2026-05-10 07:14:37,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:14:37,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d50197af08e45fc7764 HTTP/1.1" 200 None 2026-05-10 07:14:37,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:14:37,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:14:37,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:14:37,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8d50197af08e45fc7764 HTTP/1.1" 200 None 2026-05-10 07:14:37,783 - lava_callback - ERROR - Error processing callback for node 69fd8d50197af08e45fc7764: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49094 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:15:17,773 - lava_callback - INFO - Received callback for node 69fd8d74197af08e45fc7775 INFO: 172.20.0.1:49100 - "POST /node/69fd8d74197af08e45fc7775 HTTP/1.0" 202 Accepted 2026-05-10 07:15:17,782 - lava_callback - INFO - Starting async job submit for node 69fd8d74197af08e45fc7775 2026-05-10 07:15:17,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:17,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d74197af08e45fc7775 HTTP/1.1" 200 None 2026-05-10 07:15:17,810 - lava_callback - DEBUG - Processing node 69fd8d74197af08e45fc7775: baseline-arm-baylibre 2026-05-10 07:15:17,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8d74197af08e45fc7775 2026-05-10 07:15:17,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:17,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d74197af08e45fc7775 HTTP/1.1" 200 None 2026-05-10 07:15:17,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:17,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:15:17,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:17,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8d74197af08e45fc7775 HTTP/1.1" 200 None 2026-05-10 07:15:17,870 - lava_callback - ERROR - Error processing callback for node 69fd8d74197af08e45fc7775: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42542 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:15:46,860 - lava_callback - INFO - Received callback for node 69fd8d9b197af08e45fc7784 INFO: 172.20.0.1:42546 - "POST /node/69fd8d9b197af08e45fc7784 HTTP/1.0" 202 Accepted 2026-05-10 07:15:46,865 - lava_callback - INFO - Starting async job submit for node 69fd8d9b197af08e45fc7784 2026-05-10 07:15:46,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:46,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d9b197af08e45fc7784 HTTP/1.1" 200 None 2026-05-10 07:15:46,890 - lava_callback - DEBUG - Processing node 69fd8d9b197af08e45fc7784: baseline-arm-clabbe 2026-05-10 07:15:46,891 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8d9b197af08e45fc7784 2026-05-10 07:15:46,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:46,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8d9b197af08e45fc7784 HTTP/1.1" 200 None 2026-05-10 07:15:46,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:46,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:15:46,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:15:46,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8d9b197af08e45fc7784 HTTP/1.1" 200 None 2026-05-10 07:15:46,942 - lava_callback - ERROR - Error processing callback for node 69fd8d9b197af08e45fc7784: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38430 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:16:26,862 - lava_callback - INFO - Received callback for node 69fd8dc0197af08e45fc779d INFO: 172.20.0.1:38442 - "POST /node/69fd8dc0197af08e45fc779d HTTP/1.0" 202 Accepted 2026-05-10 07:16:26,868 - lava_callback - INFO - Starting async job submit for node 69fd8dc0197af08e45fc779d 2026-05-10 07:16:26,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:16:26,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8dc0197af08e45fc779d HTTP/1.1" 200 None 2026-05-10 07:16:26,892 - lava_callback - DEBUG - Processing node 69fd8dc0197af08e45fc779d: baseline-arm-clabbe 2026-05-10 07:16:26,892 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8dc0197af08e45fc779d 2026-05-10 07:16:26,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:16:26,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8dc0197af08e45fc779d HTTP/1.1" 200 None 2026-05-10 07:16:26,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:16:26,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:16:26,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:16:26,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8dc0197af08e45fc779d HTTP/1.1" 200 None 2026-05-10 07:16:26,947 - lava_callback - ERROR - Error processing callback for node 69fd8dc0197af08e45fc779d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:17:06,939 - lava_callback - INFO - Received callback for node 69fd8de5197af08e45fc77a6 INFO: 172.20.0.1:42758 - "POST /node/69fd8de5197af08e45fc77a6 HTTP/1.0" 202 Accepted 2026-05-10 07:17:06,945 - lava_callback - INFO - Starting async job submit for node 69fd8de5197af08e45fc77a6 2026-05-10 07:17:06,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:06,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8de5197af08e45fc77a6 HTTP/1.1" 200 None 2026-05-10 07:17:06,966 - lava_callback - DEBUG - Processing node 69fd8de5197af08e45fc77a6: baseline-arm-clabbe 2026-05-10 07:17:06,966 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8de5197af08e45fc77a6 2026-05-10 07:17:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:06,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8de5197af08e45fc77a6 HTTP/1.1" 200 None 2026-05-10 07:17:06,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:07,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:17:07,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:07,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8de5197af08e45fc77a6 HTTP/1.1" 200 None 2026-05-10 07:17:07,023 - lava_callback - ERROR - Error processing callback for node 69fd8de5197af08e45fc77a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40218 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:17:46,904 - lava_callback - INFO - Received callback for node 69fd8e0b197af08e45fc77b7 INFO: 172.20.0.1:40230 - "POST /node/69fd8e0b197af08e45fc77b7 HTTP/1.0" 202 Accepted 2026-05-10 07:17:46,910 - lava_callback - INFO - Starting async job submit for node 69fd8e0b197af08e45fc77b7 2026-05-10 07:17:46,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:46,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e0b197af08e45fc77b7 HTTP/1.1" 200 None 2026-05-10 07:17:46,925 - lava_callback - DEBUG - Processing node 69fd8e0b197af08e45fc77b7: baseline-arm-clabbe 2026-05-10 07:17:46,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8e0b197af08e45fc77b7 2026-05-10 07:17:46,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:46,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e0b197af08e45fc77b7 HTTP/1.1" 200 None 2026-05-10 07:17:46,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:46,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:17:46,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:17:46,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8e0b197af08e45fc77b7 HTTP/1.1" 200 None 2026-05-10 07:17:46,976 - lava_callback - ERROR - Error processing callback for node 69fd8e0b197af08e45fc77b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:18:26,985 - lava_callback - INFO - Received callback for node 69fd8e32197af08e45fc77c7 INFO: 172.20.0.1:39398 - "POST /node/69fd8e32197af08e45fc77c7 HTTP/1.0" 202 Accepted 2026-05-10 07:18:26,991 - lava_callback - INFO - Starting async job submit for node 69fd8e32197af08e45fc77c7 2026-05-10 07:18:26,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:18:27,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e32197af08e45fc77c7 HTTP/1.1" 200 None 2026-05-10 07:18:27,007 - lava_callback - DEBUG - Processing node 69fd8e32197af08e45fc77c7: baseline-arm-clabbe 2026-05-10 07:18:27,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8e32197af08e45fc77c7 2026-05-10 07:18:27,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:39404 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:18:27,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e32197af08e45fc77c7 HTTP/1.1" 200 None 2026-05-10 07:18:27,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:18:27,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:18:27,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:18:27,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8e32197af08e45fc77c7 HTTP/1.1" 200 None 2026-05-10 07:18:27,064 - lava_callback - ERROR - Error processing callback for node 69fd8e32197af08e45fc77c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45514 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:19:06,988 - lava_callback - INFO - Received callback for node 69fd8e57197af08e45fc77e3 INFO: 172.20.0.1:45530 - "POST /node/69fd8e57197af08e45fc77e3 HTTP/1.0" 202 Accepted 2026-05-10 07:19:06,994 - lava_callback - INFO - Starting async job submit for node 69fd8e57197af08e45fc77e3 2026-05-10 07:19:06,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:07,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e57197af08e45fc77e3 HTTP/1.1" 200 None 2026-05-10 07:19:07,010 - lava_callback - DEBUG - Processing node 69fd8e57197af08e45fc77e3: baseline-arm-clabbe 2026-05-10 07:19:07,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8e57197af08e45fc77e3 2026-05-10 07:19:07,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:07,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e57197af08e45fc77e3 HTTP/1.1" 200 None 2026-05-10 07:19:07,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:07,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:19:07,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:07,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8e57197af08e45fc77e3 HTTP/1.1" 200 None 2026-05-10 07:19:07,062 - lava_callback - ERROR - Error processing callback for node 69fd8e57197af08e45fc77e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49874 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:19:47,109 - lava_callback - INFO - Received callback for node 69fd8e7c197af08e45fc77ed INFO: 172.20.0.1:49886 - "POST /node/69fd8e7c197af08e45fc77ed HTTP/1.0" 202 Accepted 2026-05-10 07:19:47,119 - lava_callback - INFO - Starting async job submit for node 69fd8e7c197af08e45fc77ed 2026-05-10 07:19:47,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:47,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e7c197af08e45fc77ed HTTP/1.1" 200 None 2026-05-10 07:19:47,134 - lava_callback - DEBUG - Processing node 69fd8e7c197af08e45fc77ed: baseline-arm-clabbe 2026-05-10 07:19:47,134 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8e7c197af08e45fc77ed 2026-05-10 07:19:47,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:47,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8e7c197af08e45fc77ed HTTP/1.1" 200 None 2026-05-10 07:19:47,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:47,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:19:47,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:19:47,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8e7c197af08e45fc77ed HTTP/1.1" 200 None 2026-05-10 07:19:47,181 - lava_callback - ERROR - Error processing callback for node 69fd8e7c197af08e45fc77ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58966 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:20:07,073 - lava_callback - INFO - Received callback for node 69fd8ea4197af08e45fc77fe INFO: 172.20.0.1:58972 - "POST /node/69fd8ea4197af08e45fc77fe HTTP/1.0" 202 Accepted 2026-05-10 07:20:07,078 - lava_callback - INFO - Starting async job submit for node 69fd8ea4197af08e45fc77fe 2026-05-10 07:20:07,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:07,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ea4197af08e45fc77fe HTTP/1.1" 200 None 2026-05-10 07:20:07,098 - lava_callback - DEBUG - Processing node 69fd8ea4197af08e45fc77fe: baseline-arm-clabbe 2026-05-10 07:20:07,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8ea4197af08e45fc77fe 2026-05-10 07:20:07,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:07,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ea4197af08e45fc77fe HTTP/1.1" 200 None 2026-05-10 07:20:07,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:07,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:20:07,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:07,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8ea4197af08e45fc77fe HTTP/1.1" 200 None 2026-05-10 07:20:07,148 - lava_callback - ERROR - Error processing callback for node 69fd8ea4197af08e45fc77fe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58450 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:20:47,068 - lava_callback - INFO - Received callback for node 69fd8ec9197af08e45fc780f INFO: 172.20.0.1:58456 - "POST /node/69fd8ec9197af08e45fc780f HTTP/1.0" 202 Accepted 2026-05-10 07:20:47,078 - lava_callback - INFO - Starting async job submit for node 69fd8ec9197af08e45fc780f 2026-05-10 07:20:47,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:47,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ec9197af08e45fc780f HTTP/1.1" 200 None 2026-05-10 07:20:47,096 - lava_callback - DEBUG - Processing node 69fd8ec9197af08e45fc780f: baseline-arm-clabbe 2026-05-10 07:20:47,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8ec9197af08e45fc780f 2026-05-10 07:20:47,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:47,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ec9197af08e45fc780f HTTP/1.1" 200 None 2026-05-10 07:20:47,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:47,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:20:47,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:20:47,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8ec9197af08e45fc780f HTTP/1.1" 200 None 2026-05-10 07:20:47,154 - lava_callback - ERROR - Error processing callback for node 69fd8ec9197af08e45fc780f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46188 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:21:27,112 - lava_callback - INFO - Received callback for node 69fd8ef0197af08e45fc7824 INFO: 172.20.0.1:46200 - "POST /node/69fd8ef0197af08e45fc7824 HTTP/1.0" 202 Accepted 2026-05-10 07:21:27,118 - lava_callback - INFO - Starting async job submit for node 69fd8ef0197af08e45fc7824 2026-05-10 07:21:27,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:21:27,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ef0197af08e45fc7824 HTTP/1.1" 200 None 2026-05-10 07:21:27,135 - lava_callback - DEBUG - Processing node 69fd8ef0197af08e45fc7824: baseline-arm-clabbe 2026-05-10 07:21:27,135 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8ef0197af08e45fc7824 2026-05-10 07:21:27,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:21:27,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8ef0197af08e45fc7824 HTTP/1.1" 200 None 2026-05-10 07:21:27,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:21:27,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:21:27,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:21:27,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8ef0197af08e45fc7824 HTTP/1.1" 200 None 2026-05-10 07:21:27,181 - lava_callback - ERROR - Error processing callback for node 69fd8ef0197af08e45fc7824: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51680 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:22:07,198 - lava_callback - INFO - Received callback for node 69fd8f15197af08e45fc7832 INFO: 172.20.0.1:51694 - "POST /node/69fd8f15197af08e45fc7832 HTTP/1.0" 202 Accepted 2026-05-10 07:22:07,207 - lava_callback - INFO - Starting async job submit for node 69fd8f15197af08e45fc7832 2026-05-10 07:22:07,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:07,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8f15197af08e45fc7832 HTTP/1.1" 200 None 2026-05-10 07:22:07,223 - lava_callback - DEBUG - Processing node 69fd8f15197af08e45fc7832: baseline-arm-clabbe 2026-05-10 07:22:07,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8f15197af08e45fc7832 2026-05-10 07:22:07,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:07,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8f15197af08e45fc7832 HTTP/1.1" 200 None 2026-05-10 07:22:07,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:07,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:22:07,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:07,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8f15197af08e45fc7832 HTTP/1.1" 200 None 2026-05-10 07:22:07,276 - lava_callback - ERROR - Error processing callback for node 69fd8f15197af08e45fc7832: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:22:47,162 - lava_callback - INFO - Received callback for node 69fd8f3a197af08e45fc7843 INFO: 172.20.0.1:53094 - "POST /node/69fd8f3a197af08e45fc7843 HTTP/1.0" 202 Accepted 2026-05-10 07:22:47,172 - lava_callback - INFO - Starting async job submit for node 69fd8f3a197af08e45fc7843 2026-05-10 07:22:47,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:47,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8f3a197af08e45fc7843 HTTP/1.1" 200 None 2026-05-10 07:22:47,195 - lava_callback - DEBUG - Processing node 69fd8f3a197af08e45fc7843: baseline-arm-clabbe 2026-05-10 07:22:47,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd8f3a197af08e45fc7843 2026-05-10 07:22:47,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:47,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd8f3a197af08e45fc7843 HTTP/1.1" 200 None 2026-05-10 07:22:47,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:47,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:22:47,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:22:47,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd8f3a197af08e45fc7843 HTTP/1.1" 200 None 2026-05-10 07:22:47,255 - lava_callback - ERROR - Error processing callback for node 69fd8f3a197af08e45fc7843: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:28:38,567 - lava_callback - INFO - Received callback for node 69fd9093197af08e45fc78ed INFO: 172.20.0.1:42182 - "POST /node/69fd9093197af08e45fc78ed HTTP/1.0" 202 Accepted 2026-05-10 07:28:38,573 - lava_callback - INFO - Starting async job submit for node 69fd9093197af08e45fc78ed 2026-05-10 07:28:38,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:28:38,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9093197af08e45fc78ed HTTP/1.1" 200 None 2026-05-10 07:28:38,616 - lava_callback - DEBUG - Processing node 69fd9093197af08e45fc78ed: baseline-arm64-baylibre 2026-05-10 07:28:38,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9093197af08e45fc78ed 2026-05-10 07:28:38,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:28:38,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9093197af08e45fc78ed HTTP/1.1" 200 None 2026-05-10 07:28:38,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:28:38,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 07:28:38,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:28:38,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9093197af08e45fc78ed HTTP/1.1" 200 None 2026-05-10 07:28:38,774 - lava_callback - ERROR - Error processing callback for node 69fd9093197af08e45fc78ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37428 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:29:47,586 - lava_callback - INFO - Received callback for node 69fd90e7197af08e45fc790d INFO: 172.20.0.1:37438 - "POST /node/69fd90e7197af08e45fc790d HTTP/1.0" 202 Accepted 2026-05-10 07:29:47,592 - lava_callback - INFO - Starting async job submit for node 69fd90e7197af08e45fc790d 2026-05-10 07:29:47,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:29:47,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd90e7197af08e45fc790d HTTP/1.1" 200 None 2026-05-10 07:29:47,607 - lava_callback - DEBUG - Processing node 69fd90e7197af08e45fc790d: baseline-arm64-clabbe 2026-05-10 07:29:47,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd90e7197af08e45fc790d 2026-05-10 07:29:47,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:29:47,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd90e7197af08e45fc790d HTTP/1.1" 200 None 2026-05-10 07:29:47,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:29:47,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 07:29:47,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:29:47,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd90e7197af08e45fc790d HTTP/1.1" 200 None 2026-05-10 07:29:47,653 - lava_callback - ERROR - Error processing callback for node 69fd90e7197af08e45fc790d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:31:07,607 - lava_callback - INFO - Received callback for node 69fd9137197af08e45fc7931 INFO: 172.20.0.1:35126 - "POST /node/69fd9137197af08e45fc7931 HTTP/1.0" 202 Accepted 2026-05-10 07:31:07,612 - lava_callback - INFO - Starting async job submit for node 69fd9137197af08e45fc7931 2026-05-10 07:31:07,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:31:07,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9137197af08e45fc7931 HTTP/1.1" 200 None 2026-05-10 07:31:07,628 - lava_callback - DEBUG - Processing node 69fd9137197af08e45fc7931: baseline-arm64-clabbe 2026-05-10 07:31:07,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9137197af08e45fc7931 2026-05-10 07:31:07,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:31:07,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9137197af08e45fc7931 HTTP/1.1" 200 None 2026-05-10 07:31:07,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:31:07,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 07:31:07,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:31:07,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9137197af08e45fc7931 HTTP/1.1" 200 None 2026-05-10 07:31:07,676 - lava_callback - ERROR - Error processing callback for node 69fd9137197af08e45fc7931: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:32:27,624 - lava_callback - INFO - Received callback for node 69fd9188197af08e45fc795b INFO: 172.20.0.1:37846 - "POST /node/69fd9188197af08e45fc795b HTTP/1.0" 202 Accepted 2026-05-10 07:32:27,630 - lava_callback - INFO - Starting async job submit for node 69fd9188197af08e45fc795b 2026-05-10 07:32:27,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:32:27,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9188197af08e45fc795b HTTP/1.1" 200 None 2026-05-10 07:32:27,649 - lava_callback - DEBUG - Processing node 69fd9188197af08e45fc795b: baseline-arm64-clabbe 2026-05-10 07:32:27,649 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9188197af08e45fc795b 2026-05-10 07:32:27,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:32:27,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9188197af08e45fc795b HTTP/1.1" 200 None 2026-05-10 07:32:27,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:32:27,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 07:32:27,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:32:27,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9188197af08e45fc795b HTTP/1.1" 200 None 2026-05-10 07:32:27,696 - lava_callback - ERROR - Error processing callback for node 69fd9188197af08e45fc795b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52916 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:33:47,688 - lava_callback - INFO - Received callback for node 69fd91cb197af08e45fc797b INFO: 172.20.0.1:52920 - "POST /node/69fd91cb197af08e45fc797b HTTP/1.0" 202 Accepted 2026-05-10 07:33:47,694 - lava_callback - INFO - Starting async job submit for node 69fd91cb197af08e45fc797b 2026-05-10 07:33:47,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:33:47,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd91cb197af08e45fc797b HTTP/1.1" 200 None 2026-05-10 07:33:47,709 - lava_callback - DEBUG - Processing node 69fd91cb197af08e45fc797b: baseline-arm-clabbe 2026-05-10 07:33:47,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd91cb197af08e45fc797b 2026-05-10 07:33:47,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:33:47,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd91cb197af08e45fc797b HTTP/1.1" 200 None 2026-05-10 07:33:47,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:33:47,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69f7e5b8559eef1735ba5737 HTTP/1.1" 200 None 2026-05-10 07:33:47,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:33:47,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd91cb197af08e45fc797b HTTP/1.1" 200 None 2026-05-10 07:33:47,787 - lava_callback - ERROR - Error processing callback for node 69fd91cb197af08e45fc797b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50882 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:34:47,713 - lava_callback - INFO - Received callback for node 69fd9201197af08e45fc7992 INFO: 172.20.0.1:50898 - "POST /node/69fd9201197af08e45fc7992 HTTP/1.0" 202 Accepted 2026-05-10 07:34:47,718 - lava_callback - INFO - Starting async job submit for node 69fd9201197af08e45fc7992 2026-05-10 07:34:47,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:34:47,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9201197af08e45fc7992 HTTP/1.1" 200 None 2026-05-10 07:34:47,732 - lava_callback - DEBUG - Processing node 69fd9201197af08e45fc7992: baseline-arm64-clabbe 2026-05-10 07:34:47,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9201197af08e45fc7992 2026-05-10 07:34:47,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:34:47,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9201197af08e45fc7992 HTTP/1.1" 200 None 2026-05-10 07:34:47,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:34:47,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 07:34:47,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:34:47,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9201197af08e45fc7992 HTTP/1.1" 200 None 2026-05-10 07:34:47,786 - lava_callback - ERROR - Error processing callback for node 69fd9201197af08e45fc7992: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34962 - "GET /node/67f955119fa3bd5292537374%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.20.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52534 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:36:07,834 - lava_callback - INFO - Received callback for node 69fd9253197af08e45fc79bc INFO: 172.20.0.1:52540 - "POST /node/69fd9253197af08e45fc79bc HTTP/1.0" 202 Accepted 2026-05-10 07:36:07,840 - lava_callback - INFO - Starting async job submit for node 69fd9253197af08e45fc79bc 2026-05-10 07:36:07,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:36:07,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9253197af08e45fc79bc HTTP/1.1" 200 None 2026-05-10 07:36:07,867 - lava_callback - DEBUG - Processing node 69fd9253197af08e45fc79bc: baseline-arm64-clabbe 2026-05-10 07:36:07,867 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9253197af08e45fc79bc 2026-05-10 07:36:07,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:36:07,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9253197af08e45fc79bc HTTP/1.1" 200 None 2026-05-10 07:36:07,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:36:07,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 07:36:07,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:36:07,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9253197af08e45fc79bc HTTP/1.1" 200 None 2026-05-10 07:36:07,918 - lava_callback - ERROR - Error processing callback for node 69fd9253197af08e45fc79bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35392 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:37:27,865 - lava_callback - INFO - Received callback for node 69fd92aa197af08e45fc79d9 INFO: 172.20.0.1:35398 - "POST /node/69fd92aa197af08e45fc79d9 HTTP/1.0" 202 Accepted 2026-05-10 07:37:27,873 - lava_callback - INFO - Starting async job submit for node 69fd92aa197af08e45fc79d9 2026-05-10 07:37:27,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:37:27,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd92aa197af08e45fc79d9 HTTP/1.1" 200 None 2026-05-10 07:37:27,897 - lava_callback - DEBUG - Processing node 69fd92aa197af08e45fc79d9: baseline-arm64-clabbe 2026-05-10 07:37:27,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd92aa197af08e45fc79d9 2026-05-10 07:37:27,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:37:27,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd92aa197af08e45fc79d9 HTTP/1.1" 200 None 2026-05-10 07:37:27,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:37:27,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd2bff197af08e45fc2de3 HTTP/1.1" 200 None 2026-05-10 07:37:27,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:37:27,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd92aa197af08e45fc79d9 HTTP/1.1" 200 None 2026-05-10 07:37:27,956 - lava_callback - ERROR - Error processing callback for node 69fd92aa197af08e45fc79d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46556 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:38:39,425 - lava_callback - INFO - Received callback for node 69fd92f2197af08e45fc79fa INFO: 172.20.0.1:46566 - "POST /node/69fd92f2197af08e45fc79fa HTTP/1.0" 202 Accepted 2026-05-10 07:38:39,430 - lava_callback - INFO - Starting async job submit for node 69fd92f2197af08e45fc79fa 2026-05-10 07:38:39,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:38:39,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd92f2197af08e45fc79fa HTTP/1.1" 200 None 2026-05-10 07:38:39,450 - lava_callback - DEBUG - Processing node 69fd92f2197af08e45fc79fa: baseline-arm64-baylibre 2026-05-10 07:38:39,451 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd92f2197af08e45fc79fa 2026-05-10 07:38:39,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:38:39,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd92f2197af08e45fc79fa HTTP/1.1" 200 None 2026-05-10 07:38:39,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:38:39,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:38:39,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:38:39,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd92f2197af08e45fc79fa HTTP/1.1" 200 None 2026-05-10 07:38:39,503 - lava_callback - ERROR - Error processing callback for node 69fd92f2197af08e45fc79fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38504 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:39:59,086 - lava_callback - INFO - Received callback for node 69fd9345197af08e45fc7a1f INFO: 172.20.0.1:38516 - "POST /node/69fd9345197af08e45fc7a1f HTTP/1.0" 202 Accepted 2026-05-10 07:39:59,095 - lava_callback - INFO - Starting async job submit for node 69fd9345197af08e45fc7a1f 2026-05-10 07:39:59,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:39:59,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9345197af08e45fc7a1f HTTP/1.1" 200 None 2026-05-10 07:39:59,118 - lava_callback - DEBUG - Processing node 69fd9345197af08e45fc7a1f: baseline-arm64-baylibre 2026-05-10 07:39:59,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9345197af08e45fc7a1f 2026-05-10 07:39:59,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:39:59,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9345197af08e45fc7a1f HTTP/1.1" 200 None 2026-05-10 07:39:59,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:39:59,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:39:59,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:39:59,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9345197af08e45fc7a1f HTTP/1.1" 200 None 2026-05-10 07:39:59,180 - lava_callback - ERROR - Error processing callback for node 69fd9345197af08e45fc7a1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47536 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:41:19,193 - lava_callback - INFO - Received callback for node 69fd9396197af08e45fc7a3e INFO: 172.20.0.1:47540 - "POST /node/69fd9396197af08e45fc7a3e HTTP/1.0" 202 Accepted 2026-05-10 07:41:19,198 - lava_callback - INFO - Starting async job submit for node 69fd9396197af08e45fc7a3e 2026-05-10 07:41:19,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:41:19,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9396197af08e45fc7a3e HTTP/1.1" 200 None 2026-05-10 07:41:19,213 - lava_callback - DEBUG - Processing node 69fd9396197af08e45fc7a3e: baseline-arm64-baylibre 2026-05-10 07:41:19,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9396197af08e45fc7a3e 2026-05-10 07:41:19,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:41:19,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9396197af08e45fc7a3e HTTP/1.1" 200 None 2026-05-10 07:41:19,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:41:19,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:41:19,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:41:19,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9396197af08e45fc7a3e HTTP/1.1" 200 None 2026-05-10 07:41:19,272 - lava_callback - ERROR - Error processing callback for node 69fd9396197af08e45fc7a3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45234 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:42:39,242 - lava_callback - INFO - Received callback for node 69fd93e6197af08e45fc7a64 INFO: 172.20.0.1:45244 - "POST /node/69fd93e6197af08e45fc7a64 HTTP/1.0" 202 Accepted 2026-05-10 07:42:39,248 - lava_callback - INFO - Starting async job submit for node 69fd93e6197af08e45fc7a64 2026-05-10 07:42:39,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:42:39,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd93e6197af08e45fc7a64 HTTP/1.1" 200 None 2026-05-10 07:42:39,262 - lava_callback - DEBUG - Processing node 69fd93e6197af08e45fc7a64: baseline-arm64-baylibre 2026-05-10 07:42:39,262 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd93e6197af08e45fc7a64 2026-05-10 07:42:39,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:42:39,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd93e6197af08e45fc7a64 HTTP/1.1" 200 None 2026-05-10 07:42:39,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:42:39,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:42:39,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:42:39,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd93e6197af08e45fc7a64 HTTP/1.1" 200 None 2026-05-10 07:42:39,308 - lava_callback - ERROR - Error processing callback for node 69fd93e6197af08e45fc7a64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39410 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:43:59,357 - lava_callback - INFO - Received callback for node 69fd9438197af08e45fc7a86 INFO: 172.20.0.1:39426 - "POST /node/69fd9438197af08e45fc7a86 HTTP/1.0" 202 Accepted 2026-05-10 07:43:59,363 - lava_callback - INFO - Starting async job submit for node 69fd9438197af08e45fc7a86 2026-05-10 07:43:59,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:43:59,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9438197af08e45fc7a86 HTTP/1.1" 200 None 2026-05-10 07:43:59,378 - lava_callback - DEBUG - Processing node 69fd9438197af08e45fc7a86: baseline-arm64-baylibre 2026-05-10 07:43:59,379 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9438197af08e45fc7a86 2026-05-10 07:43:59,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:43:59,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9438197af08e45fc7a86 HTTP/1.1" 200 None 2026-05-10 07:43:59,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:43:59,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:43:59,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:43:59,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9438197af08e45fc7a86 HTTP/1.1" 200 None 2026-05-10 07:43:59,433 - lava_callback - ERROR - Error processing callback for node 69fd9438197af08e45fc7a86: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35982 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:45:39,359 - lava_callback - INFO - Received callback for node 69fd9496197af08e45fc7aa9 INFO: 172.20.0.1:35990 - "POST /node/69fd9496197af08e45fc7aa9 HTTP/1.0" 202 Accepted 2026-05-10 07:45:39,366 - lava_callback - INFO - Starting async job submit for node 69fd9496197af08e45fc7aa9 2026-05-10 07:45:39,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:45:39,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9496197af08e45fc7aa9 HTTP/1.1" 200 None 2026-05-10 07:45:39,381 - lava_callback - DEBUG - Processing node 69fd9496197af08e45fc7aa9: baseline-arm64-baylibre 2026-05-10 07:45:39,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9496197af08e45fc7aa9 2026-05-10 07:45:39,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:45:39,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9496197af08e45fc7aa9 HTTP/1.1" 200 None 2026-05-10 07:45:39,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:45:39,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:45:39,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:45:39,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9496197af08e45fc7aa9 HTTP/1.1" 200 None 2026-05-10 07:45:39,429 - lava_callback - ERROR - Error processing callback for node 69fd9496197af08e45fc7aa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46654 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:46:59,538 - lava_callback - INFO - Received callback for node 69fd94ed197af08e45fc7ad0 INFO: 172.20.0.1:46668 - "POST /node/69fd94ed197af08e45fc7ad0 HTTP/1.0" 202 Accepted 2026-05-10 07:46:59,544 - lava_callback - INFO - Starting async job submit for node 69fd94ed197af08e45fc7ad0 2026-05-10 07:46:59,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:46:59,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd94ed197af08e45fc7ad0 HTTP/1.1" 200 None 2026-05-10 07:46:59,559 - lava_callback - DEBUG - Processing node 69fd94ed197af08e45fc7ad0: baseline-arm64-baylibre 2026-05-10 07:46:59,559 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd94ed197af08e45fc7ad0 2026-05-10 07:46:59,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:46:59,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd94ed197af08e45fc7ad0 HTTP/1.1" 200 None 2026-05-10 07:46:59,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:46:59,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:46:59,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:46:59,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd94ed197af08e45fc7ad0 HTTP/1.1" 200 None 2026-05-10 07:46:59,611 - lava_callback - ERROR - Error processing callback for node 69fd94ed197af08e45fc7ad0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43220 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:48:19,671 - lava_callback - INFO - Received callback for node 69fd953f197af08e45fc7af7 INFO: 172.20.0.1:43222 - "POST /node/69fd953f197af08e45fc7af7 HTTP/1.0" 202 Accepted 2026-05-10 07:48:19,677 - lava_callback - INFO - Starting async job submit for node 69fd953f197af08e45fc7af7 2026-05-10 07:48:19,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:48:19,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd953f197af08e45fc7af7 HTTP/1.1" 200 None 2026-05-10 07:48:19,694 - lava_callback - DEBUG - Processing node 69fd953f197af08e45fc7af7: baseline-arm64-baylibre 2026-05-10 07:48:19,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd953f197af08e45fc7af7 2026-05-10 07:48:19,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:48:19,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd953f197af08e45fc7af7 HTTP/1.1" 200 None 2026-05-10 07:48:19,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:48:19,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:48:19,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:48:19,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd953f197af08e45fc7af7 HTTP/1.1" 200 None 2026-05-10 07:48:19,762 - lava_callback - ERROR - Error processing callback for node 69fd953f197af08e45fc7af7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43966 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:49:39,693 - lava_callback - INFO - Received callback for node 69fd958e197af08e45fc7b20 INFO: 172.20.0.1:43980 - "POST /node/69fd958e197af08e45fc7b20 HTTP/1.0" 202 Accepted 2026-05-10 07:49:39,698 - lava_callback - INFO - Starting async job submit for node 69fd958e197af08e45fc7b20 2026-05-10 07:49:39,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:49:39,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd958e197af08e45fc7b20 HTTP/1.1" 200 None 2026-05-10 07:49:39,714 - lava_callback - DEBUG - Processing node 69fd958e197af08e45fc7b20: baseline-arm64-baylibre 2026-05-10 07:49:39,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd958e197af08e45fc7b20 2026-05-10 07:49:39,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:49:39,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd958e197af08e45fc7b20 HTTP/1.1" 200 None 2026-05-10 07:49:39,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:49:39,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:49:39,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:49:39,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd958e197af08e45fc7b20 HTTP/1.1" 200 None 2026-05-10 07:49:39,760 - lava_callback - ERROR - Error processing callback for node 69fd958e197af08e45fc7b20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57772 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:51:08,471 - lava_callback - INFO - Received callback for node 69fd95e5197af08e45fc7b43 INFO: 172.20.0.1:57786 - "POST /node/69fd95e5197af08e45fc7b43 HTTP/1.0" 202 Accepted 2026-05-10 07:51:08,477 - lava_callback - INFO - Starting async job submit for node 69fd95e5197af08e45fc7b43 2026-05-10 07:51:08,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:51:08,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd95e5197af08e45fc7b43 HTTP/1.1" 200 None 2026-05-10 07:51:08,492 - lava_callback - DEBUG - Processing node 69fd95e5197af08e45fc7b43: baseline-arm64-clabbe 2026-05-10 07:51:08,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd95e5197af08e45fc7b43 2026-05-10 07:51:08,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:51:08,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd95e5197af08e45fc7b43 HTTP/1.1" 200 None 2026-05-10 07:51:08,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:51:08,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:51:08,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:51:08,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd95e5197af08e45fc7b43 HTTP/1.1" 200 None 2026-05-10 07:51:08,540 - lava_callback - ERROR - Error processing callback for node 69fd95e5197af08e45fc7b43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49686 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:53:48,492 - lava_callback - INFO - Received callback for node 69fd9687197af08e45fc7b7d INFO: 172.20.0.1:49702 - "POST /node/69fd9687197af08e45fc7b7d HTTP/1.0" 202 Accepted 2026-05-10 07:53:48,498 - lava_callback - INFO - Starting async job submit for node 69fd9687197af08e45fc7b7d 2026-05-10 07:53:48,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:53:48,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9687197af08e45fc7b7d HTTP/1.1" 200 None 2026-05-10 07:53:48,513 - lava_callback - DEBUG - Processing node 69fd9687197af08e45fc7b7d: baseline-arm64-clabbe 2026-05-10 07:53:48,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9687197af08e45fc7b7d 2026-05-10 07:53:48,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:53:48,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9687197af08e45fc7b7d HTTP/1.1" 200 None 2026-05-10 07:53:48,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:53:48,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:53:48,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:53:48,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9687197af08e45fc7b7d HTTP/1.1" 200 None 2026-05-10 07:53:48,559 - lava_callback - ERROR - Error processing callback for node 69fd9687197af08e45fc7b7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39312 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:54:59,920 - lava_callback - INFO - Received callback for node 69fd96d2197af08e45fc7b9f INFO: 172.20.0.1:33394 - "POST /node/69fd96d2197af08e45fc7b9f HTTP/1.0" 202 Accepted 2026-05-10 07:54:59,926 - lava_callback - INFO - Starting async job submit for node 69fd96d2197af08e45fc7b9f 2026-05-10 07:54:59,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:54:59,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd96d2197af08e45fc7b9f HTTP/1.1" 200 None 2026-05-10 07:54:59,946 - lava_callback - DEBUG - Processing node 69fd96d2197af08e45fc7b9f: baseline-arm64-baylibre 2026-05-10 07:54:59,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd96d2197af08e45fc7b9f 2026-05-10 07:54:59,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:54:59,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd96d2197af08e45fc7b9f HTTP/1.1" 200 None 2026-05-10 07:54:59,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:54:59,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:54:59,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:54:59,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd96d2197af08e45fc7b9f HTTP/1.1" 200 None 2026-05-10 07:54:59,994 - lava_callback - ERROR - Error processing callback for node 69fd96d2197af08e45fc7b9f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42364 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:56:28,658 - lava_callback - INFO - Received callback for node 69fd9729197af08e45fc7bc3 INFO: 172.20.0.1:42376 - "POST /node/69fd9729197af08e45fc7bc3 HTTP/1.0" 202 Accepted 2026-05-10 07:56:28,664 - lava_callback - INFO - Starting async job submit for node 69fd9729197af08e45fc7bc3 2026-05-10 07:56:28,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:56:28,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9729197af08e45fc7bc3 HTTP/1.1" 200 None 2026-05-10 07:56:28,679 - lava_callback - DEBUG - Processing node 69fd9729197af08e45fc7bc3: baseline-arm64-clabbe 2026-05-10 07:56:28,679 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9729197af08e45fc7bc3 2026-05-10 07:56:28,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:56:28,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9729197af08e45fc7bc3 HTTP/1.1" 200 None 2026-05-10 07:56:28,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:56:28,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:56:28,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:56:28,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9729197af08e45fc7bc3 HTTP/1.1" 200 None 2026-05-10 07:56:28,728 - lava_callback - ERROR - Error processing callback for node 69fd9729197af08e45fc7bc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57116 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:58:08,743 - lava_callback - INFO - Received callback for node 69fd977c197af08e45fc7be5 INFO: 172.20.0.1:57120 - "POST /node/69fd977c197af08e45fc7be5 HTTP/1.0" 202 Accepted 2026-05-10 07:58:08,750 - lava_callback - INFO - Starting async job submit for node 69fd977c197af08e45fc7be5 2026-05-10 07:58:08,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:58:08,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd977c197af08e45fc7be5 HTTP/1.1" 200 None 2026-05-10 07:58:08,765 - lava_callback - DEBUG - Processing node 69fd977c197af08e45fc7be5: baseline-arm64-clabbe 2026-05-10 07:58:08,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd977c197af08e45fc7be5 2026-05-10 07:58:08,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:58:08,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd977c197af08e45fc7be5 HTTP/1.1" 200 None 2026-05-10 07:58:08,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:58:08,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:58:08,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:58:08,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd977c197af08e45fc7be5 HTTP/1.1" 200 None 2026-05-10 07:58:08,825 - lava_callback - ERROR - Error processing callback for node 69fd977c197af08e45fc7be5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK 2026-05-10 07:59:20,170 - lava_callback - INFO - Received callback for node 69fd97c8197af08e45fc7bfe INFO: 172.20.0.1:33038 - "POST /node/69fd97c8197af08e45fc7bfe HTTP/1.0" 202 Accepted 2026-05-10 07:59:20,176 - lava_callback - INFO - Starting async job submit for node 69fd97c8197af08e45fc7bfe 2026-05-10 07:59:20,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:59:20,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd97c8197af08e45fc7bfe HTTP/1.1" 200 None 2026-05-10 07:59:20,195 - lava_callback - DEBUG - Processing node 69fd97c8197af08e45fc7bfe: baseline-arm64-baylibre 2026-05-10 07:59:20,195 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd97c8197af08e45fc7bfe 2026-05-10 07:59:20,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:59:20,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd97c8197af08e45fc7bfe HTTP/1.1" 200 None 2026-05-10 07:59:20,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:59:20,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 07:59:20,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 07:59:20,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd97c8197af08e45fc7bfe HTTP/1.1" 200 None 2026-05-10 07:59:20,254 - lava_callback - ERROR - Error processing callback for node 69fd97c8197af08e45fc7bfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40792 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:00:48,812 - lava_callback - INFO - Received callback for node 69fd9821197af08e45fc7c20 INFO: 172.20.0.1:40806 - "POST /node/69fd9821197af08e45fc7c20 HTTP/1.0" 202 Accepted 2026-05-10 08:00:48,818 - lava_callback - INFO - Starting async job submit for node 69fd9821197af08e45fc7c20 2026-05-10 08:00:48,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:00:48,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9821197af08e45fc7c20 HTTP/1.1" 200 None 2026-05-10 08:00:48,835 - lava_callback - DEBUG - Processing node 69fd9821197af08e45fc7c20: baseline-arm64-clabbe 2026-05-10 08:00:48,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9821197af08e45fc7c20 2026-05-10 08:00:48,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:00:48,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9821197af08e45fc7c20 HTTP/1.1" 200 None 2026-05-10 08:00:48,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:00:48,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:00:48,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:00:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9821197af08e45fc7c20 HTTP/1.1" 200 None 2026-05-10 08:00:48,895 - lava_callback - ERROR - Error processing callback for node 69fd9821197af08e45fc7c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43510 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:02:08,872 - lava_callback - INFO - Received callback for node 69fd9873197af08e45fc7c44 INFO: 172.20.0.1:43520 - "POST /node/69fd9873197af08e45fc7c44 HTTP/1.0" 202 Accepted 2026-05-10 08:02:08,877 - lava_callback - INFO - Starting async job submit for node 69fd9873197af08e45fc7c44 2026-05-10 08:02:08,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:02:08,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9873197af08e45fc7c44 HTTP/1.1" 200 None 2026-05-10 08:02:08,892 - lava_callback - DEBUG - Processing node 69fd9873197af08e45fc7c44: baseline-arm64-clabbe 2026-05-10 08:02:08,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9873197af08e45fc7c44 2026-05-10 08:02:08,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:02:08,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9873197af08e45fc7c44 HTTP/1.1" 200 None 2026-05-10 08:02:08,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:02:08,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:02:08,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:02:08,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9873197af08e45fc7c44 HTTP/1.1" 200 None 2026-05-10 08:02:08,936 - lava_callback - ERROR - Error processing callback for node 69fd9873197af08e45fc7c44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:03:28,912 - lava_callback - INFO - Received callback for node 69fd98c4197af08e45fc7c60 INFO: 172.20.0.1:56410 - "POST /node/69fd98c4197af08e45fc7c60 HTTP/1.0" 202 Accepted 2026-05-10 08:03:28,918 - lava_callback - INFO - Starting async job submit for node 69fd98c4197af08e45fc7c60 2026-05-10 08:03:28,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:03:28,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd98c4197af08e45fc7c60 HTTP/1.1" 200 None 2026-05-10 08:03:28,933 - lava_callback - DEBUG - Processing node 69fd98c4197af08e45fc7c60: baseline-arm64-clabbe 2026-05-10 08:03:28,933 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd98c4197af08e45fc7c60 2026-05-10 08:03:28,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:03:28,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd98c4197af08e45fc7c60 HTTP/1.1" 200 None 2026-05-10 08:03:28,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:03:28,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:03:28,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:03:28,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd98c4197af08e45fc7c60 HTTP/1.1" 200 None 2026-05-10 08:03:28,990 - lava_callback - ERROR - Error processing callback for node 69fd98c4197af08e45fc7c60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43808 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:04:48,948 - lava_callback - INFO - Received callback for node 69fd9919197af08e45fc7c7f INFO: 172.20.0.1:43816 - "POST /node/69fd9919197af08e45fc7c7f HTTP/1.0" 202 Accepted 2026-05-10 08:04:48,955 - lava_callback - INFO - Starting async job submit for node 69fd9919197af08e45fc7c7f 2026-05-10 08:04:48,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:04:49,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9919197af08e45fc7c7f HTTP/1.1" 200 None 2026-05-10 08:04:49,007 - lava_callback - DEBUG - Processing node 69fd9919197af08e45fc7c7f: baseline-arm64-clabbe 2026-05-10 08:04:49,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9919197af08e45fc7c7f 2026-05-10 08:04:49,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:04:49,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9919197af08e45fc7c7f HTTP/1.1" 200 None 2026-05-10 08:04:49,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:04:49,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:04:49,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:04:49,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9919197af08e45fc7c7f HTTP/1.1" 200 None 2026-05-10 08:04:49,114 - lava_callback - ERROR - Error processing callback for node 69fd9919197af08e45fc7c7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36848 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:06:09,008 - lava_callback - INFO - Received callback for node 69fd996b197af08e45fc7ca0 INFO: 172.20.0.1:36864 - "POST /node/69fd996b197af08e45fc7ca0 HTTP/1.0" 202 Accepted 2026-05-10 08:06:09,015 - lava_callback - INFO - Starting async job submit for node 69fd996b197af08e45fc7ca0 2026-05-10 08:06:09,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:06:09,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd996b197af08e45fc7ca0 HTTP/1.1" 200 None 2026-05-10 08:06:09,038 - lava_callback - DEBUG - Processing node 69fd996b197af08e45fc7ca0: baseline-arm64-clabbe 2026-05-10 08:06:09,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd996b197af08e45fc7ca0 2026-05-10 08:06:09,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:06:09,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd996b197af08e45fc7ca0 HTTP/1.1" 200 None 2026-05-10 08:06:09,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:06:09,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:06:09,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:06:09,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd996b197af08e45fc7ca0 HTTP/1.1" 200 None 2026-05-10 08:06:09,096 - lava_callback - ERROR - Error processing callback for node 69fd996b197af08e45fc7ca0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59270 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:07:49,077 - lava_callback - INFO - Received callback for node 69fd99c4197af08e45fc7cc0 INFO: 172.20.0.1:59284 - "POST /node/69fd99c4197af08e45fc7cc0 HTTP/1.0" 202 Accepted 2026-05-10 08:07:49,086 - lava_callback - INFO - Starting async job submit for node 69fd99c4197af08e45fc7cc0 2026-05-10 08:07:49,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:07:49,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd99c4197af08e45fc7cc0 HTTP/1.1" 200 None 2026-05-10 08:07:49,101 - lava_callback - DEBUG - Processing node 69fd99c4197af08e45fc7cc0: baseline-arm64-clabbe 2026-05-10 08:07:49,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd99c4197af08e45fc7cc0 2026-05-10 08:07:49,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:07:49,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd99c4197af08e45fc7cc0 HTTP/1.1" 200 None 2026-05-10 08:07:49,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:07:49,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:07:49,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:07:49,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd99c4197af08e45fc7cc0 HTTP/1.1" 200 None 2026-05-10 08:07:49,160 - lava_callback - ERROR - Error processing callback for node 69fd99c4197af08e45fc7cc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58188 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:09:09,354 - lava_callback - INFO - Received callback for node 69fd9a18197af08e45fc7ce2 INFO: 172.20.0.1:58192 - "POST /node/69fd9a18197af08e45fc7ce2 HTTP/1.0" 202 Accepted 2026-05-10 08:09:09,360 - lava_callback - INFO - Starting async job submit for node 69fd9a18197af08e45fc7ce2 2026-05-10 08:09:09,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:09:09,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9a18197af08e45fc7ce2 HTTP/1.1" 200 None 2026-05-10 08:09:09,376 - lava_callback - DEBUG - Processing node 69fd9a18197af08e45fc7ce2: baseline-arm64-clabbe 2026-05-10 08:09:09,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9a18197af08e45fc7ce2 2026-05-10 08:09:09,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:09:09,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9a18197af08e45fc7ce2 HTTP/1.1" 200 None 2026-05-10 08:09:09,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:09:09,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:09:09,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:09:09,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9a18197af08e45fc7ce2 HTTP/1.1" 200 None 2026-05-10 08:09:09,426 - lava_callback - ERROR - Error processing callback for node 69fd9a18197af08e45fc7ce2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET / HTTP/1.0" 200 OK 2026-05-10 08:10:29,175 - lava_callback - INFO - Received callback for node 69fd9a6e197af08e45fc7d06 INFO: 172.20.0.1:60994 - "POST /node/69fd9a6e197af08e45fc7d06 HTTP/1.0" 202 Accepted 2026-05-10 08:10:29,181 - lava_callback - INFO - Starting async job submit for node 69fd9a6e197af08e45fc7d06 2026-05-10 08:10:29,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:10:29,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9a6e197af08e45fc7d06 HTTP/1.1" 200 None 2026-05-10 08:10:29,198 - lava_callback - DEBUG - Processing node 69fd9a6e197af08e45fc7d06: baseline-arm64-clabbe 2026-05-10 08:10:29,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69fd9a6e197af08e45fc7d06 2026-05-10 08:10:29,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:10:29,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fd9a6e197af08e45fc7d06 HTTP/1.1" 200 None 2026-05-10 08:10:29,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:10:29,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69fa8895e18d38d4ebffe713 HTTP/1.1" 200 None 2026-05-10 08:10:29,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-05-10 08:10:29,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69fd9a6e197af08e45fc7d06 HTTP/1.1" 200 None 2026-05-10 08:10:29,244 - lava_callback - ERROR - Error processing callback for node 69fd9a6e197af08e45fc7d06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 373, in async_job_submit _emit_callback_telemetry(job_node, job_callback, hierarchy) File "/home/kernelci/pipeline/lava_callback.py", line 393, in _emit_callback_telemetry job_callback.is_infra_error() File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 117, in is_infra_error lava_yaml = self._data["results"]["lava"] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]